-- Logs begin at Thu 2022-09-01 06:35:53 UTC, end at Thu 2022-09-01 08:04:00 UTC. -- Sep 01 07:05:30.659163 dv-cinder-733062-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 07:05:30.671333 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 07:05:30 2022] *** Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: nodename: dv-cinder-733062-35-iscsi Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: machine: x86_64 Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: clock source: unix Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: pcre jit disabled Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: detected number of CPU cores: 4 Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: current working directory: / Sep 01 07:05:30.673320 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: detected binary path: /usr/bin/uwsgi-core Sep 01 07:05:30.673947 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: your processes number limit is 47680 Sep 01 07:05:30.673947 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: your memory page size is 4096 bytes Sep 01 07:05:30.673947 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: detected max file descriptor number: 2048 Sep 01 07:05:30.673947 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: lock engine: pthread robust mutexes Sep 01 07:05:30.673947 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: thunder lock: enabled Sep 01 07:05:30.673947 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 07:05:30.673947 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 07:05:30.713512 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: Python main interpreter initialized at 0x561524bd29c0 Sep 01 07:05:30.713512 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: python threads support enabled Sep 01 07:05:30.713512 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: your server socket listen backlog is limited to 100 connections Sep 01 07:05:30.713512 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: your mercy for graceful operations on workers is 90 seconds Sep 01 07:05:30.713906 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 07:05:30.713906 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: *** Operational MODE: preforking *** Sep 01 07:05:30.714178 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: *** uWSGI is running in multiple interpreter mode *** Sep 01 07:05:30.714178 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: spawned uWSGI master process (pid: 105589) Sep 01 07:05:30.714343 dv-cinder-733062-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 07:05:30.718903 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: spawned uWSGI worker 1 (pid: 105604, cores: 1) Sep 01 07:05:30.718903 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: spawned uWSGI worker 2 (pid: 105605, cores: 1) Sep 01 07:05:30.718903 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 07:05:31.377105 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 07:05:31.385109 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 07:05:32.452600 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 07:05:32.452600 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: from cryptography.utils import int_from_bytes Sep 01 07:05:32.453216 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 07:05:32.453216 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: from cryptography.utils import int_from_bytes Sep 01 07:05:32.457738 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 07:05:32.457738 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: from cryptography.utils import int_from_bytes Sep 01 07:05:32.458223 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 07:05:32.458223 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: from cryptography.utils import int_from_bytes Sep 01 07:05:34.921468 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 07:05:34.922020 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 07:05:34.922234 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 07:05:34.922324 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 07:05:34.922679 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 07:05:34.922761 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 07:05:34.922841 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 07:05:34.923048 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 07:05:34.923207 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.923412 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 07:05:34.923530 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.923672 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 07:05:34.923846 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.924060 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.924155 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.924389 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.924473 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.924713 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.924809 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.925036 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.925664 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.925911 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.926008 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.926223 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.926321 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.926488 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.926667 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.926803 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.926938 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.927126 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-35-iscsi {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.927260 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.927422 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.927570 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.927721 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.927846 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.928037 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.928155 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-35-iscsi {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.928354 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.928464 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.928659 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.928763 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.928971 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.929159 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.929305 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.929444 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.929610 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.929770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.931031 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.931174 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.931315 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.931452 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.931573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.931723 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.931836 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.931954 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.932073 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.932191 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.932318 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.932448 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.932569 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.932698 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.932817 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.932936 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.933067 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.933222 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.933345 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.933455 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.933590 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.933722 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-35-iscsi {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.933881 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.934014 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.934135 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.934264 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.934384 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-35-iscsi {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.934510 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.934630 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.934748 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.934893 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.935018 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.935142 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.935268 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.935458 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.935600 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.935775 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.935925 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.936085 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.936230 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.936408 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.936503 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.936727 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.936822 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.937058 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.937199 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.937392 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.937478 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.937691 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.937776 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.937998 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.938099 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.938307 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.938412 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.938615 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.938701 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.938922 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.939009 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.939225 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.939311 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.939475 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.939571 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.939779 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.939877 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.940098 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.940185 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.940365 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.940456 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.940674 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.940772 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.941526 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.941620 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.941779 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.941882 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.942098 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.942185 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.942417 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.942512 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.942667 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.942762 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.942989 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.943076 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.943310 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.943403 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.943616 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.943712 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.943920 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.944008 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.944225 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.944318 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.944525 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.944611 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.944828 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.944914 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.945151 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.945325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.945477 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.945615 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.945749 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.945901 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.946060 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.946225 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.946441 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.946590 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.946749 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.946909 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.947046 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.947193 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.947329 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.947462 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.947595 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.947729 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.947903 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.948058 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.948211 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.948416 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.948556 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.948688 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.948834 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.948976 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.949140 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.949291 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.949427 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.949562 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.949704 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.949852 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.949987 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.950132 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.950318 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.950468 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.950612 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.950757 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.950890 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.951030 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.951164 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.951309 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.951452 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.951594 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.951736 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.951870 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.952013 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.952148 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.952294 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.952429 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.952581 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.952716 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.952872 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.953021 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.953220 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.953362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.953496 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.953639 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.953782 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.953929 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.954064 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.954197 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.954340 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.954473 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.954641 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.954861 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.955006 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.955149 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.955283 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.955424 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.955567 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.955755 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.955906 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.956042 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.956175 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.956318 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.956554 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.956705 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.956842 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.956975 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.957109 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.957294 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.957430 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.957572 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.957708 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.957848 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.957990 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.958131 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.958291 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.958451 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.958656 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.958803 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.958940 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.959073 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.959206 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.959349 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.959484 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.959626 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.959759 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.959899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.960034 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.960191 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.960327 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.960460 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.960593 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.960727 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.960868 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.961003 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.961168 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.961310 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.961450 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.961584 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.961740 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.961877 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.962038 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.962182 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.962317 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.962450 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.962591 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.962725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.962865 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.963000 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.963157 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.963298 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.963441 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.963577 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.963743 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.963886 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.964058 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.964210 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.964376 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.964524 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.964683 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.964823 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.964983 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.965154 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.965313 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.965450 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.965614 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.965766 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.965923 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.966071 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.966214 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.966356 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.966604 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:05:34.966755 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.966890 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.967033 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.967190 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.967333 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.967515 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.967654 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.967835 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.967976 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.968145 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.968285 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.968459 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.968601 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.968825 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.968968 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.969103 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.969268 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.969405 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.969557 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.969712 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.969847 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.970008 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.970160 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.970317 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.970467 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.970632 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.970773 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.970940 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.971083 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.971248 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.971390 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.971562 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.971715 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.971857 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.973806 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.973980 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.974122 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.974122 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.974405 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.974540 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.974685 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.974821 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.974964 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.975099 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.975255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.975389 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.975523 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.975657 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.975800 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.975936 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.976070 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.976070 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.976324 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.976465 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.976696 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.976908 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.977048 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.977232 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.977371 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.977506 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.977648 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.977784 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.977918 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.978058 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.978201 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.978343 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.978479 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.978612 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.978745 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.978964 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.979115 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.979267 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.979404 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.979538 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.979672 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.979813 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.979957 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.980109 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.980246 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.980379 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.980513 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.980646 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.980816 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.980978 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.981176 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.981331 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.981466 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.981599 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.981743 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.981877 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.982012 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.982145 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.982279 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.982411 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.982558 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.982705 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.982839 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.982973 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.983107 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.983240 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.983387 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.983538 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.983673 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.983813 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.983953 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.984093 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.984235 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.984380 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.984536 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.984671 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.984806 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.984939 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.985082 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.985241 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.985377 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.985525 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.985666 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.985809 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.985944 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.986086 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.986222 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.986365 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.986499 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.986642 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.986778 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.986929 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.987131 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.987272 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.987413 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.987562 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.988228 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.988367 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.988501 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.988634 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.988778 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.988926 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.989176 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.989323 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.989459 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.989592 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.989738 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.989873 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.990007 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.990141 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.990274 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.990408 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.990550 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.990695 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.990838 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.990973 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.991113 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.991248 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.991395 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.991531 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.991674 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.991809 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.991943 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.992093 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.992228 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.992373 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.992508 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.992642 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.992776 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.992918 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.993053 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.993225 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.993363 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.993504 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.993644 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.993787 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.993922 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.994055 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.994199 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.994334 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.994482 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.994630 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.994765 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.994906 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.995040 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.995173 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.995306 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.995448 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.995582 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.995716 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.995851 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.996000 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.996143 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.996284 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.996427 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.996567 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.997043 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.997293 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.997450 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.997839 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.997973 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.998106 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.998248 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.998384 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.998536 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.998672 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.998815 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.998950 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.999084 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.999322 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.999477 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.999612 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.999747 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:34.999881 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.000023 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.000171 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.000340 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.000481 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.000624 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.000760 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.000895 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.001038 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.001219 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.001361 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.001495 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.001629 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.001763 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.001906 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.002041 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.002184 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.002318 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.002452 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.002585 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.002726 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.002861 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.002995 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.003129 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.003314 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.003970 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.004116 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.004250 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.004391 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.004545 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.004681 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.004893 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.005032 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.005223 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.005364 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.005499 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.005632 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.005775 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.005921 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.006064 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.006200 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.006334 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.006478 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.006622 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.006757 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.006900 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.007034 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.007170 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.007404 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.007555 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.007697 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.007845 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.007999 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.008139 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.008294 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.008449 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.008591 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.008732 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.008881 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.009029 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.009234 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.009464 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.009623 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.009765 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.009906 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.010046 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.010195 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.010349 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.010489 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.010629 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.010768 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.010909 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.011056 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.011199 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.011340 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.011488 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.011629 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.011781 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.011931 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.012072 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.012223 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.012365 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.012506 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.012655 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.012796 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.012937 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.013077 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.013247 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.013398 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.013550 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.013692 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.013832 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.013972 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.014129 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.014271 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.014425 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.014579 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.014720 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.014860 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.015008 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.015158 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.015300 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.015439 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.015621 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.015771 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.015911 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.016072 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.016214 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.016353 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.016493 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.016645 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.016798 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.016952 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.017094 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.017259 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.017259 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.017614 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.017614 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.017911 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.018065 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.018213 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.018353 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.018500 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.018649 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.018791 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.018959 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.019101 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.019101 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.019366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.019602 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.019752 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.019911 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.020059 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.020200 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.020339 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.020493 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.020636 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.020777 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.020925 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.021066 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.021259 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.021413 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.021555 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.021694 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.021998 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.021998 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.022284 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.022284 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.022557 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.022698 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.022838 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.022987 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.023144 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.023286 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.023426 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.023573 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.023721 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.023872 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.024022 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.024163 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.024302 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.024447 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.024591 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.024732 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.024885 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.025040 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.025204 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.025357 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.025499 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.025639 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.025797 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.025945 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.026087 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.026227 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.026366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.026514 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.026662 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.026802 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.026950 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.027092 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.027240 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.027390 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.027541 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.027733 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.027888 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.027888 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.028166 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.028319 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.028460 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.028600 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.028739 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.028887 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.029035 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.029214 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.029359 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.029510 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.029732 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.029899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.030050 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.030194 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.030415 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.030567 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.030709 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.030849 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.031003 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.031158 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.031301 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.031301 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.031589 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.031729 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.031869 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.032026 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.032247 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.032395 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.032543 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.032684 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.032825 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.032974 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033182 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033295 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033383 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033465 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033545 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033624 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033721 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033804 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033883 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.033961 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.034039 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.034127 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.034221 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.034363 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.034462 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.034691 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.034786 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.034992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.035089 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.035302 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.035391 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.035608 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.035695 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.035911 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.036001 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.036212 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.036297 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.036511 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.036598 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.036830 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.036917 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.037153 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.037244 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.037468 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.037556 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.037776 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.037884 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.038116 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.038219 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.038418 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.038514 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.038724 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.038817 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.039048 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.039134 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.039357 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.039452 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.039662 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.039751 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.039965 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.040060 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.040274 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.040373 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.040580 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.040666 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.040879 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.040964 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.041206 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.041313 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.041514 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.041602 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.041821 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.041913 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.042125 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.042219 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.042426 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.042514 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.042730 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.042816 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.043027 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.043115 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.043334 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.043432 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.043636 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.043722 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.043933 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.044020 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.044232 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.044320 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.044540 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.044628 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.044847 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.044934 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.045164 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.045256 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.045470 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.045573 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.045769 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.045869 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.046075 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.046161 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.046373 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.046473 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.046675 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.046770 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.046978 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.047076 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.047282 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.047378 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.047588 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.047675 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.047890 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.047988 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.048189 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.048286 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.048497 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.048587 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.048800 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.048895 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.049101 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.049205 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.049428 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.049514 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.049729 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.049821 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.050030 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.050656 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.050857 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.050944 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.051171 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.051259 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.051476 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.051578 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.051774 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.051873 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.052083 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.052171 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.052383 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.052470 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.052687 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.052775 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.052988 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.053083 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.053322 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.053411 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.053621 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.053707 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.053923 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.054019 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.054221 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.054308 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.054523 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.054610 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.054822 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.054920 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.055127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.055213 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.055433 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.055520 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.055733 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.055900 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.056034 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.056121 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.056331 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.056418 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.056652 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.056746 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.056956 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.057052 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.057284 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.057374 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.057590 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.057679 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.057925 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.058033 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.058232 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.058324 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.058541 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.058650 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.058847 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.058948 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.059157 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.059245 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.059459 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.059553 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.059778 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.059866 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.060084 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.060171 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.060393 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.060481 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.060707 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.060810 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.060989 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.061083 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.061323 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.061412 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.061630 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.061718 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.061932 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.062031 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.062237 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.062324 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.062554 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.062640 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.062862 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.062957 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.063164 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.063254 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.063470 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.063564 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.063776 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.063872 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.064084 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.064172 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.064391 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.064478 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.064698 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.064786 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.065006 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.065091 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.065338 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.065425 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.065648 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.065737 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.066508 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.066601 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.066819 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.066908 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.067124 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.067212 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.067431 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.067519 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.067741 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.067828 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.068048 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.068154 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.068359 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.068461 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.068663 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.068764 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.068964 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.069055 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.069292 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.069392 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.069597 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.069696 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.069907 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.069998 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.070211 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.070317 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.070519 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.070616 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.070826 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.070924 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.071140 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.071240 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.071445 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.071542 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.071809 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.071896 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.072118 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.072206 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.072432 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.072521 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.072745 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.072835 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.073049 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.073166 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.073384 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.073473 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.073702 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.073788 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.074019 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.074105 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.074326 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.074414 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.074656 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.074742 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.074957 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.075044 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.075265 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.075354 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.075583 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.075678 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.075883 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.075980 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.076184 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.076277 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.076484 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.076571 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.076801 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.076898 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.077104 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.077241 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.077431 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.077517 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.077738 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.077837 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.078067 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.078169 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.078377 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.078483 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.078695 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.078804 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.079109 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.079197 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.079414 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.079501 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.079718 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.079812 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.080044 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.080130 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.080364 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.080472 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.080668 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.080812 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.080980 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.081106 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.081312 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.081401 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.081657 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.081748 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.081979 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.082067 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.082287 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.082374 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.082596 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.082682 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.082895 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.082983 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.083214 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.083302 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.083523 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.083609 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.083831 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.083918 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.084133 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.084219 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.084455 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.084552 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.084779 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.084866 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.085091 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.085256 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.085433 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.085530 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.085785 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.085872 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.086093 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.086181 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.086396 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.086492 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.086704 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.086791 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.087007 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.087095 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.087311 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.087411 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.087631 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.087726 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.087933 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.088029 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.088242 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.088331 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.088552 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.088643 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.088863 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.088963 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.089183 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.089275 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.089488 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.089575 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.089798 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.089886 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.090101 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.090189 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.090407 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.090493 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.090716 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.090803 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.091033 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.091121 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.091338 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.091424 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.091641 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.091736 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.091959 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.092048 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.092266 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.092354 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.092568 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.092666 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.092869 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.092956 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.093192 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.093283 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.093510 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.093610 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.093815 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.093910 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.094122 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.094211 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.094428 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.094526 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.094763 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.094851 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.095068 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.095154 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.095390 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.095481 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.095713 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.095799 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.096031 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.096118 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.096339 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.096426 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.096662 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.096764 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.096968 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.097606 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.097809 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.097899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.098123 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.098218 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.098426 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.098514 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.098731 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.098820 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.099033 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.099121 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.099340 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.099436 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.099641 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.099728 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.099946 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.100032 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.100251 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.100346 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.100560 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.100657 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.100857 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.100944 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.101193 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.101297 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.101503 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.101592 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.101803 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.101891 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.102105 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.102202 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.102407 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.102495 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.102723 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.102809 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.103028 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.103127 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.103335 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.103423 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.103639 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.103728 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.103959 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.104047 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.104271 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.104360 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.104585 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.104673 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.104892 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.104979 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.105225 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.105316 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.105541 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.105639 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.105855 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.105942 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.106165 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.106252 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.106473 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.106570 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.106787 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.106874 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.107096 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.107200 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.107408 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.107503 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.107719 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.107923 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.108034 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.108251 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.108339 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.108568 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.108709 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.108885 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.109179 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.109271 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.109509 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.109607 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.109823 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.109910 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.110135 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.110221 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.110443 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.110532 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.110753 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.110841 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.111063 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.111156 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.111376 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.111478 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.111689 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.111776 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.112003 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.112091 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.112318 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.112406 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.112721 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.113365 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.113557 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.113658 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.113872 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.113960 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.114186 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.114275 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.114509 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.114604 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.114827 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.114915 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.115136 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.115230 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.115448 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.115543 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.115761 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.115847 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.116075 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.116170 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.116387 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.116476 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.116699 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.116786 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.117012 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.117105 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.117348 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.117447 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.117658 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.117747 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.117969 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.118068 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.118282 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.118392 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.118593 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.118707 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.118907 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.119010 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.119221 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.119327 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.119535 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.119632 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.119844 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.119932 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.120164 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.120260 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.120479 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.120566 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.120802 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.120993 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.121179 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.121339 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.121454 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.121675 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.121774 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.122002 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.122273 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.122435 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.122839 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.122929 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.123170 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.123266 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.123496 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.123592 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.123801 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.123896 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.124108 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.124197 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.124423 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.124510 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.124734 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.124830 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.125037 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.125143 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.125367 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.125462 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.125684 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.125780 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.125984 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.126070 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.126290 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.126382 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.126600 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.126695 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.126913 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.127126 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.127214 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.127469 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.127564 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.127785 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.127873 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.128109 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.128365 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.128452 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.128718 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.128884 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.129033 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.129263 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.129406 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.129549 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.129705 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.129846 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.129990 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.130132 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.130272 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.130413 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.130560 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.130670 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.130874 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.131037 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.131177 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.131371 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.131468 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.131758 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.131846 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.132058 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.132338 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.132436 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.132653 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.132879 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.132967 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.133298 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.133477 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.133615 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.133702 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.133883 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.134191 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.134278 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.134492 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.134780 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.134875 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.135086 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.135317 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.135407 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.135674 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.135884 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.136006 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.136276 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.136429 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.136573 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.136731 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.136866 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.137004 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.137183 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.137327 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.137452 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.137670 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.137932 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.138220 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.138308 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.138660 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.138785 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.139069 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.139193 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.139515 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.139609 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.139842 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.140118 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.140206 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.140471 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.140699 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.140809 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.141097 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.141298 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.141430 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.141748 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.141867 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.142101 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.142435 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.142601 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.142751 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.143061 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.143157 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.143385 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.143703 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.144055 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.144145 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.144375 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.144675 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.144763 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.145032 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.145307 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.145398 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.145903 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.145991 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.146241 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.146530 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.146619 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.146903 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.147095 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.147222 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.147534 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.147679 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.147844 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.148153 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.148239 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.148489 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.148804 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.148893 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.149262 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.149354 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.149597 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.149762 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.150166 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.150574 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.150679 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.150779 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.150862 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.150942 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.151112 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.151218 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.151421 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.151514 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.151737 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.151836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.152053 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.152140 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.152367 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.152454 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.152683 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.152779 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.152995 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.153081 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.153332 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.153421 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.153648 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.153790 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.153970 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.154059 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.154299 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.154385 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.154619 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.154716 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.154940 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.155029 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.155258 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.155344 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.155569 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.155657 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.155880 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.155974 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.156190 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.156276 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.156501 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.156589 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.156815 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.156910 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.157161 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.157267 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.157467 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.157555 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.157775 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.157870 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.158088 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.158183 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.158507 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.158593 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.158821 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.158907 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.159145 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.159248 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.159457 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.160102 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.160296 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.160383 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.160620 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.160717 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.160936 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.161023 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.161273 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.161376 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.161588 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.161687 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.161899 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.161993 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.162229 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.162317 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.162570 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.162657 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.162898 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.162985 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.163207 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.163294 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.163514 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.163601 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.163818 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.163904 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.164120 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.164216 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.164431 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.164519 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.164741 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.164827 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.165046 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.165173 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.165376 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.165464 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.165681 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.165769 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.165987 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.166083 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.166290 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.166376 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.166594 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.166694 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.166899 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.167007 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.167204 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.167293 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.167507 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.167593 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.167808 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.167903 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.168111 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.168199 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.168411 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.168499 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.168713 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.168800 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.169014 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.169101 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.169344 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.169440 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.169649 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.169738 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.169949 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.170036 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.170251 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.170347 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.170549 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.170644 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.170850 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.170944 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.171151 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.171260 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.171483 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.171625 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.171810 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.171896 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.172123 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.172218 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.172435 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.172528 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.172742 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.172836 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.173056 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.173222 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.173393 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.173480 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.173714 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.173800 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.174048 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.174255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.174346 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.174427 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.174638 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.174728 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.174965 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.175055 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.175813 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.175910 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.176128 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.176216 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.176437 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.176525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.176746 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.176833 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.177057 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.177174 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.177396 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.177494 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.177721 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.177808 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.178031 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.178127 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.178339 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.178425 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.178661 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.178754 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.178974 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.179070 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.179293 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.179382 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.179604 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.179690 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.179911 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.180006 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.180232 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.180365 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.180539 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.180634 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.180871 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.180965 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.181176 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.181271 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.181485 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.181572 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.181792 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.181881 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.182103 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.182190 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.182411 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.182497 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.182721 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.182810 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.183035 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.183122 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.183349 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.183445 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.183673 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.183766 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.183984 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.184109 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.184292 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.184389 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.184616 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.184705 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.184940 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.185028 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.185290 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.185398 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.185610 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.185698 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.185952 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.186038 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.186269 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.186365 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.186579 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.186665 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.186882 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.186968 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.187128 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 07:05:35.187217 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:05:35.187408 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 07:05:35.339465 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO dbcounter [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Registered counter for database nova_api Sep 01 07:05:35.339678 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO dbcounter [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Registered counter for database nova_api Sep 01 07:05:35.359888 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_db.sqlalchemy.engines [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:05:35.363519 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_db.sqlalchemy.engines [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:05:35.367110 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writer thread running {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:05:35.370009 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writer thread running {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:05:35.424046 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.context [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d062ee7-b5da-4503-94b9-816b45d5ae94(cell1) {{(pid=105604) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 07:05:35.427608 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.context [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d062ee7-b5da-4503-94b9-816b45d5ae94(cell1) {{(pid=105605) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 07:05:35.428439 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:05:35.428905 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:05:35.430503 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:05:35.431215 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:05:35.431423 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:05:35.431652 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:05:35.431892 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:05:35.433470 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:05:35.433624 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:05:35.434194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:05:35.434636 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:05:35.435829 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO dbcounter [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Registered counter for database nova_cell0 Sep 01 07:05:35.436589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:05:35.438624 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO dbcounter [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Registered counter for database nova_cell0 Sep 01 07:05:35.439942 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO dbcounter [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Registered counter for database nova_cell1 Sep 01 07:05:35.442580 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO dbcounter [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Registered counter for database nova_cell1 Sep 01 07:05:35.448044 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_db.sqlalchemy.engines [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:05:35.449817 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_db.sqlalchemy.engines [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:05:35.451273 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_db.sqlalchemy.engines [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:05:35.454655 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_db.sqlalchemy.engines [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:05:35.456060 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writer thread running {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:05:35.457578 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writer thread running {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:05:35.457690 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writer thread running {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:05:35.602280 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writer thread running {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:05:35.603676 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO dbcounter [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Registered counter for database nova_cell0 Sep 01 07:05:35.611059 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO dbcounter [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Registered counter for database nova_cell0 Sep 01 07:05:35.612266 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_db.sqlalchemy.engines [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:05:35.616918 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writer thread running {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:05:35.619410 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG oslo_db.sqlalchemy.engines [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:05:35.624252 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writer thread running {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:05:35.955394 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: WARNING keystonemiddleware.auth_token [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 07:05:35.963158 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: WARNING keystonemiddleware.auth_token [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 07:05:35.964807 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: WARNING keystonemiddleware.auth_token [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 07:05:35.973092 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: WARNING keystonemiddleware.auth_token [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 07:05:36.306153 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: WARNING keystonemiddleware.auth_token [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 07:05:36.312164 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: WARNING keystonemiddleware.auth_token [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 07:05:36.317191 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: WARNING keystonemiddleware.auth_token [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 07:05:36.318010 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561524bd29c0 pid: 105604 (default app) Sep 01 07:05:36.320067 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:05:36.321343 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001776 Sep 01 07:05:36.321761 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu Sep 1 07:05:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:05:36.323182 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: WARNING keystonemiddleware.auth_token [None req-41c70dd6-339f-4b0e-86f8-caf4e9c1b832 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 07:05:36.328456 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561524bd29c0 pid: 105605 (default app) Sep 01 07:06:54.148409 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:06:54.149456 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 01 07:06:54.149855 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:06:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:06:54.166130 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:SELECT=3 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:06:54.167728 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_cell0:SELECT=3 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:06:54.168968 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_cell1:SELECT=3 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:06:54.169878 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:06:55.050697 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-a8fcfe20-2aa0-446c-972b-0f68feac36f2 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:06:55.082665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-a8fcfe20-2aa0-446c-972b-0f68feac36f2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.926028 Sep 01 07:06:55.083564 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Sep 1 07:06:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:06:57.411606 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:06:57.412514 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-922d8379-0f5b-4e5e-b5f9-9a644d925198 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 01 07:06:57.413137 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:06:57.862752 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-fcb6d91c-295f-47c8-b1cb-f8571748a1ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:06:57.916776 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-fcb6d91c-295f-47c8-b1cb-f8571748a1ba admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497627 Sep 01 07:06:57.918030 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:06:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:06:57.931538 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=3 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:06:57.932748 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_cell0:SELECT=3 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:06:57.933799 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_cell1:SELECT=3 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:06:57.935010 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:06:58.151850 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-e2f0438f-2c9c-461b-80b9-a53e764d0e72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:06:58.228697 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-e2f0438f-2c9c-461b-80b9-a53e764d0e72 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302492 Sep 01 07:06:58.229230 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 07:06:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:07:00.603598 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-fcb6d91c-295f-47c8-b1cb-f8571748a1ba admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:00.604772 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-fcb6d91c-295f-47c8-b1cb-f8571748a1ba admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Sep 01 07:07:00.605562 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:01.372486 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-576f896c-6a61-4681-b1b1-3685d4e6d9e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:01.416008 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-576f896c-6a61-4681-b1b1-3685d4e6d9e6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.804219 Sep 01 07:07:01.416807 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:01.429346 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-968feaa0-b2b8-47d8-bdaa-376d26fde775 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:01.466624 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-968feaa0-b2b8-47d8-bdaa-376d26fde775 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040927 Sep 01 07:07:01.467426 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 07:07:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:07:03.802855 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-576f896c-6a61-4681-b1b1-3685d4e6d9e6 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:03.803870 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-576f896c-6a61-4681-b1b1-3685d4e6d9e6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 01 07:07:03.804264 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:04.203835 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-3b7f0fe2-0528-454e-89e0-5bdce5f6b64a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:04.224234 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-3b7f0fe2-0528-454e-89e0-5bdce5f6b64a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413778 Sep 01 07:07:04.224864 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:07:04.236986 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-db3b8183-dd14-4efa-be8c-84b584c5a8ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:04.260881 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-db3b8183-dd14-4efa-be8c-84b584c5a8ad admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027765 Sep 01 07:07:04.261498 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 07:07:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:07:06.609435 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-3b7f0fe2-0528-454e-89e0-5bdce5f6b64a admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:06.610467 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-3b7f0fe2-0528-454e-89e0-5bdce5f6b64a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 01 07:07:06.610879 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:07.067598 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-3c8d638d-885b-4cca-862c-6440f4988325 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "swap": 0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:07.088180 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-3c8d638d-885b-4cca-862c-6440f4988325 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470325 Sep 01 07:07:07.088712 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:07.101184 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-590b5ad5-ccae-4307-a8a0-281c7a99c088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:07.125845 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-590b5ad5-ccae-4307-a8a0-281c7a99c088 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028279 Sep 01 07:07:07.126422 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 07:07:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:07:09.484653 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-3c8d638d-885b-4cca-862c-6440f4988325 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:09.485722 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-3c8d638d-885b-4cca-862c-6440f4988325 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Sep 01 07:07:09.486906 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:09.931100 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-69a5e034-5fa6-4507-a5bb-a16f895bec61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:09.949804 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-69a5e034-5fa6-4507-a5bb-a16f895bec61 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455705 Sep 01 07:07:09.950344 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:09.962445 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-9098902c-2fda-4729-8ae6-58a9fa800569 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:09.988048 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-9098902c-2fda-4729-8ae6-58a9fa800569 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029203 Sep 01 07:07:09.988623 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 07:07:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:07:12.685690 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-69a5e034-5fa6-4507-a5bb-a16f895bec61 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:12.686731 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-69a5e034-5fa6-4507-a5bb-a16f895bec61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Sep 01 07:07:12.687220 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:13.125197 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-29993e84-bb22-49a8-97d7-55d082248e9a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:13.150551 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-29993e84-bb22-49a8-97d7-55d082248e9a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456515 Sep 01 07:07:13.151091 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Sep 1 07:07:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:07:15.479769 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-69a5e034-5fa6-4507-a5bb-a16f895bec61 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:15.480830 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-69a5e034-5fa6-4507-a5bb-a16f895bec61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 01 07:07:15.481063 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:15.950888 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-24eae225-d0ae-4bc1-86a1-fa67ae0410ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "vcpus": 1, "swap": 0, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:15.975248 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-24eae225-d0ae-4bc1-86a1-fa67ae0410ee admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.487477 Sep 01 07:07:15.975939 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:15.988563 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-65dc0c3e-ec3f-4fea-be58-5837fa8cabbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:16.013890 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-65dc0c3e-ec3f-4fea-be58-5837fa8cabbb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029526 Sep 01 07:07:16.014467 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 07:07:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:07:18.363343 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-24eae225-d0ae-4bc1-86a1-fa67ae0410ee admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:18.364398 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-24eae225-d0ae-4bc1-86a1-fa67ae0410ee admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 01 07:07:18.364956 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:18.758100 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-ece263b3-268a-4f15-8ceb-60309b41dcc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:18.778743 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-ece263b3-268a-4f15-8ceb-60309b41dcc7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407408 Sep 01 07:07:18.779200 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:07:18.791385 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-eb77d618-8c94-4e42-8c6b-3ef45d6a07a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:18.815933 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-eb77d618-8c94-4e42-8c6b-3ef45d6a07a1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028104 Sep 01 07:07:18.816529 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 07:07:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:07:21.746244 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-ece263b3-268a-4f15-8ceb-60309b41dcc7 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:21.747554 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-ece263b3-268a-4f15-8ceb-60309b41dcc7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Sep 01 07:07:21.748176 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:22.200338 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-213329db-2655-4b37-b393-7ec8c00481c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "id": "3", "swap": 0}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:22.223223 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-213329db-2655-4b37-b393-7ec8c00481c7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.468601 Sep 01 07:07:22.224125 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:22.236735 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-979651ef-d00e-458f-9404-dd71ade59a7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:22.261945 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-979651ef-d00e-458f-9404-dd71ade59a7f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029178 Sep 01 07:07:22.262892 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 07:07:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:07:24.673209 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-213329db-2655-4b37-b393-7ec8c00481c7 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:24.674234 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-213329db-2655-4b37-b393-7ec8c00481c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 01 07:07:24.674634 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:07:25.110160 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-eee4bf74-1aeb-4ec9-820d-87bdcac8ae0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:25.116764 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:07:25.134152 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-eee4bf74-1aeb-4ec9-820d-87bdcac8ae0d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452908 Sep 01 07:07:25.135008 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:25.147227 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-cc81b12b-c1cc-4f99-bbd4-854d33eb1cfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:25.175039 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-cc81b12b-c1cc-4f99-bbd4-854d33eb1cfc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031552 Sep 01 07:07:25.175886 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 07:07:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:07:27.534500 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-eee4bf74-1aeb-4ec9-820d-87bdcac8ae0d admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:27.535656 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-eee4bf74-1aeb-4ec9-820d-87bdcac8ae0d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Sep 01 07:07:27.536142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:27.977922 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-67ede0e3-3fe9-4a7b-96e7-a6fbe712d8c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:28.001364 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-67ede0e3-3fe9-4a7b-96e7-a6fbe712d8c6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459122 Sep 01 07:07:28.002742 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 07:07:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:07:28.014748 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-700f1e57-17a3-4b7d-aa5e-da63bdac74bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:28.041522 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-700f1e57-17a3-4b7d-aa5e-da63bdac74bd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030299 Sep 01 07:07:28.042237 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 07:07:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:07:45.698266 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-67ede0e3-3fe9-4a7b-96e7-a6fbe712d8c6 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:45.699939 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-67ede0e3-3fe9-4a7b-96e7-a6fbe712d8c6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Sep 01 07:07:45.700503 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:45.712275 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:07:46.089396 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-c8dd5751-cd38-404d-ad72-aae4a34d82b9 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:46.108392 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-c8dd5751-cd38-404d-ad72-aae4a34d82b9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400610 Sep 01 07:07:46.108925 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Sep 1 07:07:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:07:47.154386 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-67ede0e3-3fe9-4a7b-96e7-a6fbe712d8c6 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:47.155396 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-67ede0e3-3fe9-4a7b-96e7-a6fbe712d8c6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 01 07:07:47.155789 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:07:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:47.670214 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-43b8f6f7-636f-40be-b9a3-b38f3b5ad965 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:47.675849 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.wsgi [None req-43b8f6f7-636f-40be-b9a3-b38f3b5ad965 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-43b8f6f7-636f-40be-b9a3-b38f3b5ad965 admin admin] Request method failure captured: Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Accept: application/json Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Accept-Encoding: gzip, deflate Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Connection: keep-alive Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Content-Length: 0 Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Host: 10.222.0.46 Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Openstack-Api-Version: compute 2.90 Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Openstack-System-Scope: None Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: User-Agent: python-novaclient Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Auth-Token: gAAAAABjEFpD7J29ryflU8lDUGFxNVAq1LHLI9rjwel4iakOw9JCSblmbf9suFARtgkR_Z2LTmCy4qSUHUekl4MloELrl6cZBel0_Tt-vTWLuEI5daApQcvrotUl502H1iP_5J9ukdE_LuzP8pcMEEwoBlgmLJXT7gbZWs5LzD7v_NbryaYkhcY Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Domain-Id: None Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Domain-Name: None Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Identity-Status: Confirmed Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Is-Admin-Project: True Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Domain-Id: default Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Domain-Name: Default Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Name: admin Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Role: member,reader,admin Sep 01 07:07:47.679142 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Roles: member,reader,admin Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b911f14b05394fe89de7092f0075d554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b911f14b05394fe89de7092f0075d554", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant: admin Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant-Name: admin Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User: admin Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Domain-Id: default Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Domain-Name: Default Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Id: 82706f28e6f34da4b5745e5a95638706 Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Name: admin Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: method: > Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: exception: Flavor 42 could not be found. Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: action_args: {'id': '42'} Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:07:47.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:47.681836 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.683194 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-43b8f6f7-636f-40be-b9a3-b38f3b5ad965 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:07:47.684506 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-43b8f6f7-636f-40be-b9a3-b38f3b5ad965 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388332 Sep 01 07:07:47.684506 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Sep 1 07:07:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 07:07:47.690342 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-f80ffc51-c3c0-4d4b-b152-aec0596451f5 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:47.694532 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:07:47.715607 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-f80ffc51-c3c0-4d4b-b152-aec0596451f5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028844 Sep 01 07:07:47.716137 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 07:07:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:07:47.726328 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-b73c83f5-bce5-42dc-9282-437a1886b2b2 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:47.748125 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-b73c83f5-bce5-42dc-9282-437a1886b2b2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025387 Sep 01 07:07:47.748640 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 07:07:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:07:47.758058 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-37c3843e-e241-4413-8bc1-a94e1aaab5ed admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:47.764466 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.wsgi [None req-37c3843e-e241-4413-8bc1-a94e1aaab5ed admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-37c3843e-e241-4413-8bc1-a94e1aaab5ed admin admin] Request method failure captured: Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Accept: application/json Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Accept-Encoding: gzip, deflate Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Connection: keep-alive Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Content-Length: 0 Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Host: 10.222.0.46 Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Openstack-Api-Version: compute 2.90 Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Openstack-System-Scope: None Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: User-Agent: python-novaclient Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Auth-Token: gAAAAABjEFpD7J29ryflU8lDUGFxNVAq1LHLI9rjwel4iakOw9JCSblmbf9suFARtgkR_Z2LTmCy4qSUHUekl4MloELrl6cZBel0_Tt-vTWLuEI5daApQcvrotUl502H1iP_5J9ukdE_LuzP8pcMEEwoBlgmLJXT7gbZWs5LzD7v_NbryaYkhcY Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Domain-Id: None Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Domain-Name: None Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Identity-Status: Confirmed Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Is-Admin-Project: True Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Domain-Id: default Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Domain-Name: Default Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Name: admin Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Role: member,reader,admin Sep 01 07:07:47.768314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Roles: member,reader,admin Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b911f14b05394fe89de7092f0075d554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b911f14b05394fe89de7092f0075d554", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant: admin Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant-Name: admin Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User: admin Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Domain-Id: default Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Domain-Name: Default Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Id: 82706f28e6f34da4b5745e5a95638706 Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Name: admin Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: method: > Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: exception: Flavor 42 could not be found. Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: action_args: {'id': '42'} Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:07:47.769940 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:47.770899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:47.772124 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-37c3843e-e241-4413-8bc1-a94e1aaab5ed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:07:47.773479 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-37c3843e-e241-4413-8bc1-a94e1aaab5ed admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015236 Sep 01 07:07:47.773479 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Sep 1 07:07:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 07:07:48.723438 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-b73c83f5-bce5-42dc-9282-437a1886b2b2 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:48.724476 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-b73c83f5-bce5-42dc-9282-437a1886b2b2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 01 07:07:48.724876 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:49.234483 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-05b99210-5228-426a-a0a0-fd5cdfe770f5 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:49.240829 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.wsgi [None req-05b99210-5228-426a-a0a0-fd5cdfe770f5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-05b99210-5228-426a-a0a0-fd5cdfe770f5 admin admin] Request method failure captured: Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Accept: application/json Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Accept-Encoding: gzip, deflate Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Connection: keep-alive Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Content-Length: 0 Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Host: 10.222.0.46 Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Openstack-Api-Version: compute 2.90 Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Openstack-System-Scope: None Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: User-Agent: python-novaclient Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Auth-Token: gAAAAABjEFpEK2rRGZ0kn8DFyVQeu8Vv5FKkunYKz9VP1_VyOdt4Wq5FzDTZRn8uNPP65c7Xum8RrVGsvu2Pqm0IZtK7Yz-g_RB81HxT6RmJJj8AFKb-jJEDCqbX-TvCaP2A3VGxFCpVszqMnlqjmw_eGc1qhhG_ES-e3U6vEJeFVuimgIqLyNo Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Domain-Id: None Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Domain-Name: None Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Identity-Status: Confirmed Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Is-Admin-Project: True Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Domain-Id: default Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Domain-Name: Default Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Name: admin Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Role: member,reader,admin Sep 01 07:07:49.242362 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Roles: member,reader,admin Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b911f14b05394fe89de7092f0075d554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b911f14b05394fe89de7092f0075d554", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant: admin Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant-Name: admin Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User: admin Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Domain-Id: default Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Domain-Name: Default Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Id: 82706f28e6f34da4b5745e5a95638706 Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Name: admin Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: method: > Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: exception: Flavor 84 could not be found. Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: action_args: {'id': '84'} Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:07:49.243725 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:49.244525 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.245863 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-05b99210-5228-426a-a0a0-fd5cdfe770f5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:07:49.247067 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-05b99210-5228-426a-a0a0-fd5cdfe770f5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.383594 Sep 01 07:07:49.247067 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Sep 1 07:07:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 07:07:49.254401 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-51009295-506b-4fa7-8636-e605cfd6b7f3 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:49.269396 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-51009295-506b-4fa7-8636-e605cfd6b7f3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019405 Sep 01 07:07:49.269920 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 07:07:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:07:49.279091 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-ab93c8a4-e1b8-4cd6-8c7f-f6fffa9fd2ed admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:49.294299 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-ab93c8a4-e1b8-4cd6-8c7f-f6fffa9fd2ed admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018614 Sep 01 07:07:49.294812 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 07:07:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:07:49.304407 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-3f61a9cf-1dc9-4f5c-915b-feb6fc43519c admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:49.309749 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.wsgi [None req-3f61a9cf-1dc9-4f5c-915b-feb6fc43519c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-3f61a9cf-1dc9-4f5c-915b-feb6fc43519c admin admin] Request method failure captured: Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Accept: application/json Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Accept-Encoding: gzip, deflate Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Connection: keep-alive Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Content-Length: 0 Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Host: 10.222.0.46 Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Openstack-Api-Version: compute 2.90 Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Openstack-System-Scope: None Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: User-Agent: python-novaclient Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Auth-Token: gAAAAABjEFpEK2rRGZ0kn8DFyVQeu8Vv5FKkunYKz9VP1_VyOdt4Wq5FzDTZRn8uNPP65c7Xum8RrVGsvu2Pqm0IZtK7Yz-g_RB81HxT6RmJJj8AFKb-jJEDCqbX-TvCaP2A3VGxFCpVszqMnlqjmw_eGc1qhhG_ES-e3U6vEJeFVuimgIqLyNo Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Domain-Id: None Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Domain-Name: None Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Identity-Status: Confirmed Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Is-Admin-Project: True Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Domain-Id: default Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Domain-Name: Default Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Name: admin Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Role: member,reader,admin Sep 01 07:07:49.312045 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Roles: member,reader,admin Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b911f14b05394fe89de7092f0075d554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b911f14b05394fe89de7092f0075d554", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant: admin Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant-Name: admin Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User: admin Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Domain-Id: default Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Domain-Name: Default Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Id: 82706f28e6f34da4b5745e5a95638706 Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Name: admin Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: method: > Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: exception: Flavor 84 could not be found. Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: action_args: {'id': '84'} Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:07:49.313589 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:49.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:49.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-3f61a9cf-1dc9-4f5c-915b-feb6fc43519c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:07:49.317913 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-3f61a9cf-1dc9-4f5c-915b-feb6fc43519c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012488 Sep 01 07:07:49.317913 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Sep 1 07:07:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 07:07:50.269721 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-ab93c8a4-e1b8-4cd6-8c7f-f6fffa9fd2ed admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:50.270717 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-ab93c8a4-e1b8-4cd6-8c7f-f6fffa9fd2ed admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 01 07:07:50.271097 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:07:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:50.802523 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-adba0c62-eabe-4472-9be7-c7b3b0d7d323 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:50.808442 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.wsgi [None req-adba0c62-eabe-4472-9be7-c7b3b0d7d323 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-adba0c62-eabe-4472-9be7-c7b3b0d7d323 admin admin] Request method failure captured: Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Accept: application/json Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Accept-Encoding: gzip, deflate Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Connection: keep-alive Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Content-Length: 0 Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Host: 10.222.0.46 Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Openstack-Api-Version: compute 2.90 Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Openstack-System-Scope: None Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: User-Agent: python-novaclient Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Auth-Token: gAAAAABjEFpGt9BcUW4hO-3AOCUFMoxsRtiYj5bORKAEiYts1kIWVYhGTBf8KK9rPLV7krWH7eSOlWTQlSFEVcZ7WEo0FSXpdf__Jp0DGV4MXogrKPLjUF2aHZTt3r5cf6l1LVkn3qqfqzQfbbp-CV-igj7lXD19fdWFFeSMFlJpbBUjtR6nCJo Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Domain-Id: None Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Domain-Name: None Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Identity-Status: Confirmed Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Is-Admin-Project: True Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Domain-Id: default Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Domain-Name: Default Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Project-Name: admin Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Role: member,reader,admin Sep 01 07:07:50.810043 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Roles: member,reader,admin Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b911f14b05394fe89de7092f0075d554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b911f14b05394fe89de7092f0075d554", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant: admin Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-Tenant-Name: admin Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User: admin Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Domain-Id: default Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Domain-Name: Default Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Id: 82706f28e6f34da4b5745e5a95638706 Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: X-User-Name: admin Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: method: > Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: exception: Flavor 451 could not be found. Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: action_args: {'id': '451'} Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:07:50.811524 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:50.812992 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.815255 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-adba0c62-eabe-4472-9be7-c7b3b0d7d323 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:07:50.817444 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-adba0c62-eabe-4472-9be7-c7b3b0d7d323 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405786 Sep 01 07:07:50.817444 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 07:07:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 07:07:50.821353 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2219da3c-a46e-442d-b15a-0197ebbc6f59 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:50.836536 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2219da3c-a46e-442d-b15a-0197ebbc6f59 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018767 Sep 01 07:07:50.837072 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 07:07:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:07:50.847345 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:50.862184 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018969 Sep 01 07:07:50.862870 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 07:07:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:07:50.872431 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-dd98a4a2-3c49-4010-9a27-04a0d26eaa22 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:50.878884 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.wsgi [None req-dd98a4a2-3c49-4010-9a27-04a0d26eaa22 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-dd98a4a2-3c49-4010-9a27-04a0d26eaa22 admin admin] Request method failure captured: Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Accept: application/json Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Accept-Encoding: gzip, deflate Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Connection: keep-alive Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Content-Length: 0 Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Host: 10.222.0.46 Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Openstack-Api-Version: compute 2.90 Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Openstack-System-Scope: None Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: User-Agent: python-novaclient Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Auth-Token: gAAAAABjEFpGt9BcUW4hO-3AOCUFMoxsRtiYj5bORKAEiYts1kIWVYhGTBf8KK9rPLV7krWH7eSOlWTQlSFEVcZ7WEo0FSXpdf__Jp0DGV4MXogrKPLjUF2aHZTt3r5cf6l1LVkn3qqfqzQfbbp-CV-igj7lXD19fdWFFeSMFlJpbBUjtR6nCJo Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Domain-Id: None Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Domain-Name: None Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Identity-Status: Confirmed Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Is-Admin-Project: True Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Domain-Id: default Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Domain-Name: Default Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Project-Name: admin Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Role: member,reader,admin Sep 01 07:07:50.880366 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Roles: member,reader,admin Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b911f14b05394fe89de7092f0075d554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b911f14b05394fe89de7092f0075d554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b911f14b05394fe89de7092f0075d554", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant: admin Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant-Id: b911f14b05394fe89de7092f0075d554 Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-Tenant-Name: admin Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User: admin Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Domain-Id: default Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Domain-Name: Default Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Id: 82706f28e6f34da4b5745e5a95638706 Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: X-User-Name: admin Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: method: > Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: exception: Flavor 451 could not be found. Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: action_args: {'id': '451'} Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:07:50.882127 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:50.883257 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Sep 01 07:07:50.884573 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-dd98a4a2-3c49-4010-9a27-04a0d26eaa22 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:07:50.886059 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-dd98a4a2-3c49-4010-9a27-04a0d26eaa22 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013231 Sep 01 07:07:50.886059 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 07:07:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 07:07:51.856157 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:51.857193 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 01 07:07:51.857590 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:52.384515 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-7252c08e-e4c9-4453-85f7-845259ac4bca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:52.403328 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-7252c08e-e4c9-4453-85f7-845259ac4bca admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401779 Sep 01 07:07:52.403854 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Sep 1 07:07:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:53.367569 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:53.368561 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 01 07:07:53.368957 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:53.896107 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-08246dc7-e801-464e-8cd6-f95761e08149 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:53.914612 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-08246dc7-e801-464e-8cd6-f95761e08149 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406361 Sep 01 07:07:53.915146 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Sep 1 07:07:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:54.877039 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:54.878081 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Sep 01 07:07:54.878477 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:07:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:07:55.412107 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-83136e03-8f93-4628-af02-8271a3db40e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:55.431180 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-83136e03-8f93-4628-af02-8271a3db40e5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.410443 Sep 01 07:07:55.431717 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Sep 1 07:07:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:07:56.389790 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:56.391140 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Sep 01 07:07:56.391530 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:07:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:56.923082 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-9a59d160-9f17-4f84-a364-11f4160ea7dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:07:56.941820 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-9a59d160-9f17-4f84-a364-11f4160ea7dc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.414358 Sep 01 07:07:56.942353 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Sep 1 07:07:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:07:57.916107 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:57.917104 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 01 07:07:57.917530 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:07:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:07:58.439528 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-c72ba47d-0681-4f1c-8e4e-e32ac89b05ea admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:07:58.459589 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-c72ba47d-0681-4f1c-8e4e-e32ac89b05ea admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406282 Sep 01 07:07:58.460110 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Sep 1 07:07:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:08:51.264793 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:08:51.265847 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f7be757c-a3fc-42a3-a730-a1a70135aec6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 01 07:08:51.266246 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 07:08:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:08:51.276665 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:08:51.667650 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-3ae11026-01ba-4ca7-92e3-3cc68f017c88 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:08:51.689177 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-3ae11026-01ba-4ca7-92e3-3cc68f017c88 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416946 Sep 01 07:08:51.689728 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Sep 1 07:08:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:08:51.710707 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:SELECT=14 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:08:51.714929 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-7c2f557b-c00d-4101-9bcb-bf0ba6a97568 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:08:51.723374 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-7c2f557b-c00d-4101-9bcb-bf0ba6a97568 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014142 Sep 01 07:08:51.723906 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Thu Sep 1 07:08:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:08:51.735964 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-d3702ecb-99d5-4134-8636-9de4968cf9ce admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:08:51.744798 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-d3702ecb-99d5-4134-8636-9de4968cf9ce admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012613 Sep 01 07:08:51.745368 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Thu Sep 1 07:08:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:08:51.757502 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:08:51.765764 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011777 Sep 01 07:08:51.766332 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Thu Sep 1 07:08:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:08:51.778297 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-c17153aa-ded5-4144-8959-317d3b6cb1d6 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:08:51.787783 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-c17153aa-ded5-4144-8959-317d3b6cb1d6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013059 Sep 01 07:08:51.788314 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Thu Sep 1 07:08:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:12:07.251765 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:12:07.252780 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 01 07:12:07.253223 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:12:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:12:07.393751 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=6 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:12:07.555843 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-8305fa7f-ff70-4260-b67a-f66a476a1a6c admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:12:07.559380 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-8305fa7f-ff70-4260-b67a-f66a476a1a6c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:12:07.559857 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-8305fa7f-ff70-4260-b67a-f66a476a1a6c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:12:07.560291 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-8305fa7f-ff70-4260-b67a-f66a476a1a6c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:12:07.561005 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-8305fa7f-ff70-4260-b67a-f66a476a1a6c admin admin] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:12:07.561481 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-8305fa7f-ff70-4260-b67a-f66a476a1a6c admin admin] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:12:07.561899 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-8305fa7f-ff70-4260-b67a-f66a476a1a6c admin admin] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:12:07.595460 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-8305fa7f-ff70-4260-b67a-f66a476a1a6c admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.203213 Sep 01 07:12:07.596016 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 07:12:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:12:08.413209 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:12:08.414270 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 01 07:12:08.414691 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:12:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:12:08.606162 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-b40e546d-9610-40ec-8ccf-1f56cd56a467 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:12:08.609569 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-b40e546d-9610-40ec-8ccf-1f56cd56a467 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:12:08.610039 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-b40e546d-9610-40ec-8ccf-1f56cd56a467 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:12:08.610461 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-b40e546d-9610-40ec-8ccf-1f56cd56a467 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:12:08.611160 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-b40e546d-9610-40ec-8ccf-1f56cd56a467 admin admin] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:12:08.611599 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-b40e546d-9610-40ec-8ccf-1f56cd56a467 admin admin] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:12:08.612009 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-b40e546d-9610-40ec-8ccf-1f56cd56a467 admin admin] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:12:08.631664 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-b40e546d-9610-40ec-8ccf-1f56cd56a467 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076171 Sep 01 07:12:08.632197 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 07:12:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:12:19.863811 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:12:19.864802 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 01 07:12:19.865224 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:12:20.010736 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_cell0:SELECT=4 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:12:20.011453 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_cell1:SELECT=4 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:12:20.012066 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=8 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:12:20.058930 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-a655a031-03cf-4eef-a0c7-74c40300e1f8 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:12:20.062319 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-a655a031-03cf-4eef-a0c7-74c40300e1f8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:12:20.062782 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-a655a031-03cf-4eef-a0c7-74c40300e1f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:12:20.063203 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-a655a031-03cf-4eef-a0c7-74c40300e1f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:12:20.063901 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-a655a031-03cf-4eef-a0c7-74c40300e1f8 admin admin] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:12:20.064340 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-a655a031-03cf-4eef-a0c7-74c40300e1f8 admin admin] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:12:20.064749 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-a655a031-03cf-4eef-a0c7-74c40300e1f8 admin admin] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:12:20.089496 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-a655a031-03cf-4eef-a0c7-74c40300e1f8 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083141 Sep 01 07:12:20.090012 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 07:12:20 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:12:20.909586 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:12:20.911234 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-152771ce-dc2f-4a5c-9b56-f23a8239a327 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 01 07:12:20.911626 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 07:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:12:21.104480 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-974389c8-29b5-4d8b-a299-2cc143220f93 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:12:21.107907 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-974389c8-29b5-4d8b-a299-2cc143220f93 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:12:21.108375 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-974389c8-29b5-4d8b-a299-2cc143220f93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:12:21.108801 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-974389c8-29b5-4d8b-a299-2cc143220f93 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:12:21.109543 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-974389c8-29b5-4d8b-a299-2cc143220f93 admin admin] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:12:21.110016 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-974389c8-29b5-4d8b-a299-2cc143220f93 admin admin] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:12:21.110430 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-974389c8-29b5-4d8b-a299-2cc143220f93 admin admin] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:12:21.133253 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-974389c8-29b5-4d8b-a299-2cc143220f93 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079086 Sep 01 07:12:21.133787 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 07:12:21 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:13:18.159783 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: Thu Sep 1 07:13:18 2022 - graceful shutdown triggered... Sep 01 07:13:18.160277 dv-cinder-733062-35-iscsi devstack@n-api.service[105604]: Gracefully killing worker 1 (pid: 105604)... Sep 01 07:13:18.160714 dv-cinder-733062-35-iscsi devstack@n-api.service[105605]: Gracefully killing worker 2 (pid: 105605)... Sep 01 07:13:18.161981 dv-cinder-733062-35-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 07:13:19.160519 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: worker 1 buried after 1 seconds Sep 01 07:13:19.161053 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: worker 2 buried after 1 seconds Sep 01 07:13:19.161053 dv-cinder-733062-35-iscsi devstack@n-api.service[105589]: goodbye to uWSGI. Sep 01 07:13:19.162684 dv-cinder-733062-35-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 07:13:19.163224 dv-cinder-733062-35-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 07:13:19.166023 dv-cinder-733062-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 07:13:19.175066 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 07:13:19 2022] *** Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: nodename: dv-cinder-733062-35-iscsi Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: machine: x86_64 Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: clock source: unix Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: pcre jit disabled Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: detected number of CPU cores: 4 Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: current working directory: / Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: detected binary path: /usr/bin/uwsgi-core Sep 01 07:13:19.177044 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: your processes number limit is 47680 Sep 01 07:13:19.177957 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: your memory page size is 4096 bytes Sep 01 07:13:19.177957 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: detected max file descriptor number: 2048 Sep 01 07:13:19.177957 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: lock engine: pthread robust mutexes Sep 01 07:13:19.177957 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: thunder lock: enabled Sep 01 07:13:19.177957 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 07:13:19.177957 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 07:13:19.219789 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: Python main interpreter initialized at 0x557525bcd9c0 Sep 01 07:13:19.219789 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: python threads support enabled Sep 01 07:13:19.219789 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: your server socket listen backlog is limited to 100 connections Sep 01 07:13:19.219789 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: your mercy for graceful operations on workers is 90 seconds Sep 01 07:13:19.220202 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 07:13:19.220277 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: *** Operational MODE: preforking *** Sep 01 07:13:19.220527 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: *** uWSGI is running in multiple interpreter mode *** Sep 01 07:13:19.220527 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: spawned uWSGI master process (pid: 120618) Sep 01 07:13:19.220729 dv-cinder-733062-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 07:13:19.223349 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: spawned uWSGI worker 1 (pid: 120637, cores: 1) Sep 01 07:13:19.223693 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: spawned uWSGI worker 2 (pid: 120638, cores: 1) Sep 01 07:13:19.223846 dv-cinder-733062-35-iscsi devstack@n-api.service[120618]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 07:13:19.885475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 07:13:19.892779 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 07:13:21.044796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 07:13:21.044796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: from cryptography.utils import int_from_bytes Sep 01 07:13:21.045537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 07:13:21.045537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: from cryptography.utils import int_from_bytes Sep 01 07:13:21.045871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 07:13:21.045871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: from cryptography.utils import int_from_bytes Sep 01 07:13:21.046724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 07:13:21.046724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: from cryptography.utils import int_from_bytes Sep 01 07:13:23.479773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 07:13:23.480354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 07:13:23.480464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 07:13:23.480810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 07:13:23.481052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 07:13:23.481532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.481858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.482171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.482482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.482817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.483111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.483422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.483736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.484056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.484308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.484617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.484935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-35-iscsi {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.485448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.485756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.486062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.486374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.486673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.487001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.487291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.487788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.489233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.489233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.489233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.489512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.490311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.490615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.491468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.491468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.492022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.492022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.492431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-35-iscsi {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.492650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.493152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.493152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.493583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.493798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.494096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.494395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.494713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.495014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.495337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.495686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.495984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.496279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.496565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.496867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.497195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.497513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.497806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.498104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.498347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.498648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.498962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.499276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.499591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.499835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.500014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 07:13:23.500472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.500629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 07:13:23.500789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.500789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.501084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 07:13:23.501264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.501417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 07:13:23.501562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.501725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 07:13:23.501906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.502095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.502253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.502406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.502567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.502721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.502863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.503019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.503172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.503321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.503472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.503617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.503768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.503768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.504294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.505847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.505959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-35-iscsi {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.506939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.507023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.507107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.507184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.507448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.507561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.507733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.507846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.508027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.508225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.508331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.508537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.508633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.508909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.509052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.509275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.509396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.509573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.509701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.509819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.510015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.510118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.510352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.510453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.510667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.510770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.510975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.511067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.511273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.511373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.511571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.511663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.511862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.511962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.512158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.512252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.512455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.512580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-35-iscsi {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.512753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.512899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.513051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.513238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.513377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.513555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.513661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.513957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.514048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.514255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.514357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.514549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.514656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.514861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.514966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.515174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.515267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.515473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.515582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.515771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.515863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.516073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.516177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.516372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.516466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.516683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.516776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.516982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.517083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.517306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.517455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.517613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.517714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.517908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.518012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.518205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.518311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.518517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.518662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.518752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.518835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.519060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.519154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.519383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.519491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.519678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.519768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.519976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.520075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.520252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.520351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.520504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.520604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.520846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.520952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.521198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.521318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.521498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.521589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.521797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.521903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.522095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.522203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.522391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.522493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.522689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.522795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.522983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.523082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.523286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.523384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.523592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.523702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.523890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.523983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.524189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.524281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.524486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.524592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.524797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.524950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.525127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.525248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.525466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.525624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.525766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.525859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.526075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.526168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.526409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.526509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.526726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.526817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.527034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.527132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.527340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.527440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.527646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.527743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.527956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.528048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.528259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.528358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.528562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.528654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.528864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.528970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.529197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.529293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.529512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.529616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.529764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.529865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.530070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.530169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.530377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.530514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.530694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.530801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.531003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.531109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.531309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.531400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.531614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.531718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.531955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.532066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.532236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.532345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.532570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.532908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.533242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.533409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.533569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.533725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.533943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.534092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.534236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.534380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.534535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.534687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.534880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.535056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.535296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.535454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.535606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.535763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.535923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.536078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.536232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.536376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.537282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.537369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.537479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.537479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.537810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.537896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.537994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.538083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.538161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.538259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.538353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.538427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.538503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.538592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.538676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.538748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.539002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.539088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.539295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.539397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.539607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.539806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.539968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.540106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.540241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.540348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.540548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.540643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.540855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.540965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.541176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.541276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.541479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.541572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.541780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.541891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.542084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.542177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.542384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.542479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.542701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.542808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.543004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.543096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.543311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.543458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.543620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.543763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.543921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.544062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.544222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.544355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.544522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.544673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.544813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.544996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.545146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.545307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.545543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.545691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.545823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.545953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.546089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.546220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.546361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.546482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 07:13:23.546603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.546721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.546893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.547038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.547212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.547347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.547514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.547659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.547816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.547960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.548126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.548263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.548431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.548566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.548738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.548882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.549100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.549302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.549432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.549573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.549714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.549855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.549985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.550120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.550250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.550383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.550571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.550713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.550899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.551032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.551279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.551413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.551553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.551699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.551840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.551970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.552640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.552777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.552944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.553088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.553276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.553423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.553576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.553711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.553865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.554038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.554174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.554356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.554492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.554700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.554844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.555051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.555190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.555329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.555460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.555705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.555848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.555981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.556099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.556229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.556358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.556497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.556635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.556773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.556911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.557043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.557239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.557385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.557577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.557704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.557892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.558038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.558217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.558353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.558534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.558671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.558968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.559173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.559396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.559530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.559652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.559807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.559807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.560084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.560406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.560550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.560654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.560736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.560902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.560993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.561332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.561464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.561654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.561800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.561931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.562074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.562204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.562325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.562461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.562622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.562763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.562891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.562996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.563151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.563298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.563432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.563527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.563726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.563887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.563980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.564065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.564156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.564241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.564338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.564537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.564633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.564853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.564947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.565182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.565306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.565492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.565586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.565797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.565890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.566105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.566198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.566416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.566517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.566720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.566812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.567032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.567125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.567336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.567432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.567648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.567784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.568513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.568616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.568826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.568921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.569141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.569236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.569472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.569585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.569772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.569866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.570081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.570182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.570392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.570487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.570702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.570802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.571008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.571107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.571315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.571407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.571626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.571720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.571930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.572035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.572234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.572335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.572536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.572637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.572836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.572942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.573152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.573250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.573461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.573553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.573770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.573865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.574074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.574174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.574376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.574482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.574674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.574764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.574981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.575085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.575284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.575385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.575581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.575682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.575879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.575971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.576183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.576276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.576503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.576595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.576806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.576898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.577108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.577263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.577445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.577589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.577744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.577837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.578041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.578147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.578343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.578441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.578645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.578744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.578942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.579045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.579240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.579333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.579535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.579648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.579845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.579946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.580158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.580295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.580458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.580594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.580767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.580912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.581080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.581208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.581405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.581500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.581714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.581807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.582018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.582110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.582320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.582413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.582633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.582727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.582938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.583031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.583239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.583358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.583571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.583711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.583877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.583971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.584182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.584281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.584488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.584590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.584804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.584896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.585107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.585231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.585432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.585527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.585734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.585829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.586032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.586134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.586345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.586448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.586655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.586748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.587013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.587228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.587337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.587556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.587656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.587865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.587968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.588179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.588280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.588495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.588598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.588835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.589006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.589162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.589271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.589480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.589601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.589790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.589885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.590091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.590191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.590397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.590547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.590697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.590792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.590996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.591095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.591299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.591399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.591598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.591691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.591896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.591988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.592193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.592287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.592496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.592589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.592792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.592892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.593090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.593243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.593410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.593516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.593709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.593810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.594015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.594108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.594310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.594402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.594615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.594716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.594912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.595005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.595226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.595319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.595526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.595643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.595824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.595924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.596120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.596213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.596421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.596575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.596724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.596816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.597039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.597191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.597377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.597483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.597685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.597786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.597991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.598084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.598303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.598396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.598599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.598698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.598919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.599032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.599239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.599333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.599538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.599638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.599835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.599932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.600138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.600232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.600439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.600538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.600736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.600846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.601042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.601200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.601371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.601475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.601674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.601776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.601976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.602069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.602272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.602366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.602572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.602679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.602868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.602968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.603178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.603271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.603483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.603585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.603781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.603880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.604079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.604180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.604383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.604488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.604685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.604781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.604980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.605074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.605325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.605420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.605624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.605722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.605935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.606035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.606233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.606358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.606536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.606642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.606833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.606949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.607133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.607241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.607434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.607553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.607737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.607842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.608044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.608154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.608343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.608436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.608639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.608741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.608936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.609261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.609359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.609557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.609662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.609852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.610001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.610153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.610255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.610469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.610600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.610781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.610910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.611080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.611224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.611384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.611523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.611683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.611839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.611982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.612148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.612283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.612461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.612585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.612771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.612872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.613080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.613330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.613435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.613535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.613713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.613815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.614025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.614119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.614334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.614427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.615164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.615284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.615471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.615571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.615772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.615874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.616070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.616178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.616376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.616468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.616694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.616801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.616995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.617102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.617340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.617446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.617651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.617751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.617965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.618139 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.618271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.618379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.618575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.618667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.618882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.618983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.619180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.619278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.619488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.619588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.619791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.619885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.620097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.620197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.620395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.620488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.620690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.620784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.621002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.621100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.621340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.621435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.621645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.621739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.621959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.622053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.622273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.622376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.622575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.622667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.622873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.622971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.623174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.623281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.623474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.623573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.623771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.623870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.624074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.624181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.624377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.624477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.624682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.624775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.624986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.625191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.625316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.625408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.625620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.625711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.625923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.626015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.626223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.626325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.626528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.626628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.626831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.626924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.627128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.627227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.627441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.627541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.627743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.627842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.628039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.628143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.628341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.628435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.628640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.628741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.628943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.629045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.629263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.629423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.629568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.629689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.630136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.630298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.630994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.631132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.631302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.631396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.631627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.631732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.631943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.632046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.632249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.632342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.632555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.632656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.632859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.632960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.633184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.633292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.633495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.633597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.633808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.633903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.634132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.634232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.634452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.634559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.634749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.634841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.635054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.635147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.635360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.635459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.635659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.635805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.635960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.636054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.636260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.636360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.636565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.636657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.636870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.637008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.637201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.637310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.637511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.637605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.637818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.637911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.638140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.638242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.638452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.638594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.638765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.638901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.639075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.639317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.639436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.639531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.639715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.639816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.640024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.640127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.640384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.640484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.640694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.640787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.640999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.641193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.641350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.641456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.641666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.641760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.641984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.642079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.642300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.642400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.642598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.642690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.642912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.643012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.643225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.643317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.643535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.643627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.643842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.643935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.644147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.644240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.644471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.644597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.644785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.644921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.645100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.645217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.645445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.645551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.645760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.645871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.646085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.646179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.646391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.646494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.646689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.646789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.647047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.647154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.647297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.647403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.647595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.647694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.647901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.647995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.648207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.648308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.648512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.648612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.648812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.648912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.649162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.649260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.649449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.649555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.649749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.649850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.650060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.650153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.650366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.650457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.650670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.650769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.650984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.651128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.651282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.651419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.651589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.651682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.651890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.651992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.652238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.652343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.652488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.652584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.652785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.652879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.653137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.653249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.653443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.653544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.653754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.653854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.654076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.654231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.654399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.654495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.654703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.654804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.655029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.655137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.655342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.655433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.655650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.655744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.655959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.656063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.656277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.656378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.656577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.656671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.656880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.656973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.657221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.657341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.657517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.657618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.657814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.657914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.658110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.658205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.658413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.658518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.658710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.658804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.659007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.659101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.659303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.659410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.659620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.659714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.659918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.660017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.660234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.660379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.660537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.660695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.660836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.661006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.661167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.661471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.661574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.661788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.661920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.662092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.662192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.662414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.662507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.662715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.662808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.663033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.663134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.663345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.663440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.663653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.663753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.663965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.664071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.664272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.664372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.664580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.664673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.664890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.664996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.665227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.665324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.665535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.665638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.665844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.665945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.666154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.666255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.666464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.666556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.666783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.666986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.667202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.667316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.667529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.667644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.667845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.667947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.668171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.668274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.668502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.668594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.668812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.668907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.669158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.669256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.669450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.669551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.669757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.669850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.670061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.670154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.670387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.670549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.670727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.670896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.671084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.671182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.671322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.671423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.671631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.671757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.671934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.672066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.672237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.672344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.672543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.672637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.672855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.672947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.673216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.673333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.673521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.673615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.673831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.673932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.674141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.674272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.674449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.674546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.674756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.674858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.675061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.675158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.675366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.675466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.675672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.675773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.675979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.676073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.676280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.676380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.676589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.676697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.676904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.677001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.677764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.677865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.678094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.678205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.678405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.678535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.678711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.678811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.679019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.679123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.679329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.679422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.679672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.679841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.680002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.680149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.680309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.680475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.680614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.680793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.680926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.681110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.681280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.681442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.681588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.681752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.681846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.682072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.682210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.682372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.682466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.682671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.682788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.682979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.683086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.683282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.683377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.683580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.683675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.683896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.683991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.684202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.684297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.684500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.684601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.684807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.684906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.685108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.685254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.685469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.685654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.685776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.685999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.686101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.686335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.686447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.686619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.686713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.686940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.687041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.687258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.687352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.687561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.687662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.687879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.687980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.688181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.688279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.688482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.688582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.688791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.688892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.689099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.689228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.689422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.689523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.689720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.689822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.690025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.690155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.690328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.690575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.690676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.690912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.691007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.691208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.691337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.691528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.691626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.691830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.691935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.692130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.692231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.692431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.692524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.693292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.693412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.693598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.693693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.693897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.693992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.694197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.694298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.694495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.694588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.694803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.694906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.695102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.695204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.695406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.695507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.695707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.695809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.696014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.696115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.696313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.696415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.696615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.696717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.696961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.697054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.697386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.697494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.697687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.697788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.697986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.698087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.698295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.698389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.698599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.698739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.698911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.699005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.699217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.699310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.699520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.699622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.699842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.699935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.700152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.700258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.700466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.700680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.700785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.701006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.701100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.701346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.701449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.701677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.701771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.702003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.702107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.702308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.702438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.702612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.702706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.702913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.703016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.703233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.703478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.703573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.703798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.703892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.704125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.704225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.704432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.704533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.704736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.704837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.705040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.705153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.705385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.705479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.705691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.705865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.705995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.706097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.706300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.706393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.706601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.706706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.706905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.706999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.707208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.707302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.707517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.707619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.707823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.707917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.708127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.708267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.708478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.708590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.708786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.708885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.709097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.709353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.709466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.709703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.709797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.710014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.710106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.710318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.710421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.710622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.710715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.710930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.711023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.711249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.711350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.711555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.711648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.711854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.711946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.712164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.712257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.712485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.712578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.712800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.712901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.713109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.713235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.713438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.713533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.713753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.713847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.714066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.714162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.714372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.714479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.714683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.714775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.714988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.715088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.715309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.715407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.715615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.715719 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.715924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.716024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.716232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.716326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.716538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.716639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.716837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.716931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.717151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.717260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.717469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.717571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.717777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.717871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.718081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.718222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.718381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.718485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.718682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.718774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.718984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.719084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.719282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.719377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.719581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.719676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.719882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.719983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.720180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.720283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.720483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.720623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.720780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.720935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.721078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.721265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.721398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.721587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.721682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.721900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.722003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.722225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.722321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.722539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.722668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.722832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.722926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.723131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.723232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.723427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.723541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.723729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.724526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.724639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.724852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.724961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.725196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.725317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.725507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.725607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.725826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.725925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.726131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.726237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.726447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.726557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.726746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.726839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.727062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.727157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.727373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.727473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.727679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.727778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.727988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.728089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.728300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.728392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.728607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.728756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.728914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.729046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.729245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.729351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.729552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.729654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.729907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.730009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.730165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.730259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.730473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.730581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.730784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.730885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.731083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.731177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.731393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.731499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.731702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.731795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.732015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.732117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.732325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.732433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.732629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.732723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.732951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.733045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.733283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.733379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.733590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.733684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.733893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.733987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.734198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.734300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.734502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.734602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.734810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.734983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.735114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.735209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.735417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.735519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.735726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.735830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.736033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.736134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.736351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.736446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.736668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.736779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.736972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.737073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.737315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.737412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.737635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.737739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.737981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.738075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.738287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.738426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.738612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.738706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.738925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.739021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.739229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.739322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.739536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.740179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.740432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.740528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.740672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 07:13:23.740772 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.741055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.741389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.741699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.742013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.742334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.742647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.742955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.743260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.743571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.743878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.744186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.744493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.744798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.745107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.745430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.745735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.746040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.746346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.746651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.746956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.747264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.747569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.747876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.748182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.748487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.748791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.749175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.749478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.749800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.750124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.750438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.750762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.751077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.751402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.751727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.752047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.752409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.752692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.753016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.753344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.753661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.753976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.754290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.754602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.755211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.755546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.755856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.756183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.756505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.756830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.757208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.757481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.757812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.758127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.758442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.758753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.759064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.759377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.759702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.760015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.760328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.760647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.760963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.761489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.761990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.762459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.762942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.763423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.763940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.764422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.764775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.765127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.765453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.765774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.766426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 07:13:23.766426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 07:13:23.801990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Registered counter for database nova_api Sep 01 07:13:23.822490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:13:23.828750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Registered counter for database nova_api Sep 01 07:13:23.828920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:13:23.848533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:13:23.855925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:13:23.890368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.context [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d062ee7-b5da-4503-94b9-816b45d5ae94(cell1) {{(pid=120637) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 07:13:23.894436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:13:23.894911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:13:23.896498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:13:23.897253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:13:23.897693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:13:23.899628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:13:23.901613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Registered counter for database nova_cell0 Sep 01 07:13:23.905568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Registered counter for database nova_cell1 Sep 01 07:13:23.913090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.context [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d062ee7-b5da-4503-94b9-816b45d5ae94(cell1) {{(pid=120638) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 07:13:23.913362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:13:23.915041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:13:23.917222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:13:23.917710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:13:23.919307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:13:23.920053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:13:23.920504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:13:23.921152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:13:23.922509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:13:23.922649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:13:23.924520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Registered counter for database nova_cell0 Sep 01 07:13:23.929254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Registered counter for database nova_cell1 Sep 01 07:13:23.936462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:13:23.940847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:13:23.947068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:13:23.949586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:13:24.072400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Registered counter for database nova_cell0 Sep 01 07:13:24.079602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:13:24.084741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:13:24.110269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO dbcounter [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Registered counter for database nova_cell0 Sep 01 07:13:24.119216 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 07:13:24.123922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writer thread running {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 07:13:24.400595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 07:13:24.408270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 07:13:24.455193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 07:13:24.463103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 07:13:24.752148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 07:13:24.758383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-4f747092-6b68-4bbc-8d17-a13d4d7762fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 07:13:24.764847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557525bcd9c0 pid: 120637 (default app) Sep 01 07:13:24.809046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 07:13:24.815204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: WARNING keystonemiddleware.auth_token [None req-4e2f07ae-a9fc-445f-a576-437abaeb0474 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 07:13:24.820630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557525bcd9c0 pid: 120638 (default app) Sep 01 07:14:00.976786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:00.978415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:00.979542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:00.982538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:02.816347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-45f4301d-2d33-4044-8994-bdfb2f80043d tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Action: 'create', calling method: .version_select at 0x7f78d025d0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-341689165", "metadata": {"Type": "work"}}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:04.964197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-362b5119-c6d3-4d41-848b-d2d7751efbbc tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78d030a1f0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:05.043959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:05.044904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:05.046236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:05.050845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:05.588153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-45f4301d-2d33-4044-8994-bdfb2f80043d tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.616169 Sep 01 07:14:05.589872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Sep 1 07:14:00 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4619 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 07:14:05.605202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7f8b3279-c711-4bcc-936e-357a36bd9e53 tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Calling method '.version_select at 0x7f78d012cf70>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:05.840798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-362b5119-c6d3-4d41-848b-d2d7751efbbc tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/00f7aa6f-62e7-4956-8e72-4218c60c403e" status: 200 len: 350 microversion: 2.1 time: 1.362386 Sep 01 07:14:05.841418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:04 2022] GET /compute/v2.1/os-volumes/00f7aa6f-62e7-4956-8e72-4218c60c403e => generated 350 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:14:06.016891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7f8b3279-c711-4bcc-936e-357a36bd9e53 tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c" status: 200 len: 353 microversion: 2.1 time: 0.416100 Sep 01 07:14:06.017981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:05 2022] GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c => generated 353 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:14:06.037633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b52eadf5-d3e4-4a4e-8650-dfc2cc5fff0f tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Calling method '.version_select at 0x7f78d0128040>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:06.287418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b52eadf5-d3e4-4a4e-8650-dfc2cc5fff0f tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c" status: 200 len: 353 microversion: 2.1 time: 0.254168 Sep 01 07:14:06.289077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:06 2022] GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c => generated 353 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:06.312521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-582d4c17-1cc9-4e9c-a39b-07e561334603 tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Calling method '.version_select at 0x7f78d0142670>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:06.607562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-582d4c17-1cc9-4e9c-a39b-07e561334603 tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c" status: 202 len: 0 microversion: 2.1 time: 0.299763 Sep 01 07:14:06.609788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:14:06 2022] DELETE /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:14:06.619249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01ab1ed7-7158-450d-b69d-ba4e35a18fa7 tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Calling method '.version_select at 0x7f78d0128310>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:06.829565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01ab1ed7-7158-450d-b69d-ba4e35a18fa7 tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c" status: 200 len: 352 microversion: 2.1 time: 0.215086 Sep 01 07:14:06.830127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:06 2022] GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c => generated 352 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:14:07.843862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5cb8a7f9-3974-493e-b179-65c9eecf187c tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Calling method '.version_select at 0x7f78d0142d30>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:07.967649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5cb8a7f9-3974-493e-b179-65c9eecf187c tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c" status: 200 len: 352 microversion: 2.1 time: 0.127546 Sep 01 07:14:07.968233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:07 2022] GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:08.981551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e91f1d34-f2f3-4cca-b979-26793912679e tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Calling method '.version_select at 0x7f78d0128820>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:09.093621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e91f1d34-f2f3-4cca-b979-26793912679e tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c" status: 200 len: 352 microversion: 2.1 time: 0.115791 Sep 01 07:14:09.100266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:08 2022] GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:14:10.074455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a1fcfe92-31fa-45ff-a25d-aca2a8b2b301 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78d0142a60>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:10.108072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81cbd713-0511-4251-a2f5-d266735b57ea tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Calling method '.version_select at 0x7f78d0128ee0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:10.327349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1fcfe92-31fa-45ff-a25d-aca2a8b2b301 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/7dce2597-91fe-482b-b85a-a134c0773bc9" status: 200 len: 350 microversion: 2.1 time: 0.256207 Sep 01 07:14:10.328589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:10 2022] GET /compute/v2.1/os-volumes/7dce2597-91fe-482b-b85a-a134c0773bc9 => generated 350 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:10.364101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-81cbd713-0511-4251-a2f5-d266735b57ea tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] HTTP exception thrown: Volume 4f617d3a-1bb5-4130-9e7b-80853eca893c could not be found. Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81cbd713-0511-4251-a2f5-d266735b57ea tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Request method failure captured: Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c HTTP/1.1 Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFu4ZDd4k1VYPBcBQKSIUiYdlL89OS2pzPvpYp8D-6YZc5S7cJoltkSHOi7Z3BzzPxV8X3wnNSoAjYO9dKQi9OghRcUXLS4SOBYxIIii58iMKl49s2NISZsfngaOYaj-styf8jzrl8MV5REa-NQ_9zw25zLOwuQRZ8848sl6xBGful4 Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 4e94525a3f1c4bc5a6a8846e3a1d134e Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesGetTestJSON-336879018 Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:14:10.372071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4e94525a3f1c4bc5a6a8846e3a1d134e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4e94525a3f1c4bc5a6a8846e3a1d134e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4e94525a3f1c4bc5a6a8846e3a1d134e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4e94525a3f1c4bc5a6a8846e3a1d134e", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesGetTestJSON-336879018 Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 4e94525a3f1c4bc5a6a8846e3a1d134e Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesGetTestJSON-336879018 Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesGetTestJSON-336879018-project Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 2a306c3e658e4a52a8618cf48117953b Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesGetTestJSON-336879018-project Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Volume 4f617d3a-1bb5-4130-9e7b-80853eca893c could not be found. Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '4f617d3a-1bb5-4130-9e7b-80853eca893c'} Sep 01 07:14:10.373457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f617d3a-1bb5-4130-9e7b-80853eca893c could not be found. (HTTP 404) (Request-ID: req-91376f3b-c7d3-43fc-8118-9a1cbfb311f5) Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:14:10.374292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 07:14:10.375406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f617d3a-1bb5-4130-9e7b-80853eca893c could not be found. Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 07:14:10.376347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f617d3a-1bb5-4130-9e7b-80853eca893c could not be found. Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f617d3a-1bb5-4130-9e7b-80853eca893c could not be found. Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81cbd713-0511-4251-a2f5-d266735b57ea tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] Returning 404 to user: Volume 4f617d3a-1bb5-4130-9e7b-80853eca893c could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81cbd713-0511-4251-a2f5-d266735b57ea tempest-VolumesGetTestJSON-336879018 tempest-VolumesGetTestJSON-336879018-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c" status: 404 len: 109 microversion: 2.1 time: 0.269757 Sep 01 07:14:10.377407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 5/10] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:10 2022] GET /compute/v2.1/os-volumes/4f617d3a-1bb5-4130-9e7b-80853eca893c => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 07:14:10.503539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-566053499", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:10.749271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] validate_networks() for [('9f24c055-6940-48ec-a310-bd5e7c9fb6d1', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:14:11.549087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-166792745", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "networks": [{"uuid": "91917c4e-d2ce-4593-a032-c5eeea5792f2"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:11.763783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] validate_networks() for [('91917c4e-d2ce-4593-a032-c5eeea5792f2', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:14:12.514990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:14:12.515506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:14:12.516019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:14:12.516978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:14:12.517626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:14:12.562483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:12.567570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:12.568810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:12.570044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:12.571960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:12.572781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:12.658834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Getting quotas for project c1705474b7954cf1926e9beb2d548587. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:14:12.678661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Getting quotas for user db4f0928502a43b490de01afc587a846 and project c1705474b7954cf1926e9beb2d548587. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:14:12.703131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:14:12.712165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:14:12.890370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b1f101a3-bf42-47c4-9bac-431af26af269 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.540628 Sep 01 07:14:12.894433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 6/11] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:14:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:14:12.914489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6bf49cf2-42cc-45bc-a274-2dc10a99b2f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:12.917024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6bf49cf2-42cc-45bc-a274-2dc10a99b2f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:13.091040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:14:13.092541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:14:13.093219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:14:13.093343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6bf49cf2-42cc-45bc-a274-2dc10a99b2f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:13.093907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:14:13.094481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:14:13.139864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:13.142720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:13.143557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6bf49cf2-42cc-45bc-a274-2dc10a99b2f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1221 microversion: 2.1 time: 0.240145 Sep 01 07:14:13.144727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:13.146532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:13.148952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:13.149597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:13.173075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 7/12] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:12 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1221 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:13.274150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Getting quotas for project 78f0be015ba44cdfa6c64038e16bd5cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:14:13.300512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Getting quotas for user 561fa6572e0b4b949d1c09ee9e9d5e66 and project 78f0be015ba44cdfa6c64038e16bd5cb. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:14:13.335817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:14:13.375144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:14:13.595927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-75150006", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:13.664576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9434b642-c469-4135-9300-39ef9c0cd6d1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.395558 Sep 01 07:14:13.677022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 6/13] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:14:13.699258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b5b38d3-158e-49df-9462-dfcf1fec9953 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:13.703022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] validate_networks() for [('9f24c055-6940-48ec-a310-bd5e7c9fb6d1', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:14:13.703886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b5b38d3-158e-49df-9462-dfcf1fec9953 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:13.958258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6b5b38d3-158e-49df-9462-dfcf1fec9953 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:13.992285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b5b38d3-158e-49df-9462-dfcf1fec9953 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1214 microversion: 2.1 time: 0.306373 Sep 01 07:14:14.007974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 7/14] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:13 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:14.389371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c6b2e6b7-9057-4b87-9870-8c6e38468c0c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Action: 'create', calling method: .version_select at 0x7f78d001b0d0>, body: {"keypair": {"name": "tempest-keypair-1204319312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA0dBcDTowSK5jCpMkDIM9kueNH39AKvNrRtxzCF5gW0icAx1H3ViUaInO0IyliKEAXD3gNJnfA5totWyxpCiLu0DMqmebXzca2S64T9lcpFE+mNcHO5uxE22oxkVXopg=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:14.493870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-c6b2e6b7-9057-4b87-9870-8c6e38468c0c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Getting quotas for project e2774daeaf2945eea5b6f33ad4ea2bdf. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:14:14.507885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-c6b2e6b7-9057-4b87-9870-8c6e38468c0c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Getting quotas for user 2096dd4d4b6f49fc8572a4bcd9689248 and project e2774daeaf2945eea5b6f33ad4ea2bdf. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:14:14.582479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c6b2e6b7-9057-4b87-9870-8c6e38468c0c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.531636 Sep 01 07:14:14.583578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 8/15] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Sep 1 07:14:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 533 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 07:14:14.859500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:14:14.860065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:14:14.860683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:14:14.861102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:14:14.867949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:14:14.891063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:14.901444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:14.905749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:14.907033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:14.910384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:14.911772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:14.954761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Getting quotas for project c1705474b7954cf1926e9beb2d548587. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:14:14.961464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Getting quotas for user db4f0928502a43b490de01afc587a846 and project c1705474b7954cf1926e9beb2d548587. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:14:14.995667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:14:14.998800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:14:15.015011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-030fdf83-9730-4502-bd72-e5d87c0bf24e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:15.015835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-030fdf83-9730-4502-bd72-e5d87c0bf24e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:15.123533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e992981-6166-4a41-ab00-552465495979 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.533856 Sep 01 07:14:15.125184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 8/16] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:14:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:14:15.136553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-030fdf83-9730-4502-bd72-e5d87c0bf24e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:15.145386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47d10ad5-df02-4dc9-bc1d-9f929baabb3f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:15.149670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-030fdf83-9730-4502-bd72-e5d87c0bf24e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1214 microversion: 2.1 time: 0.135804 Sep 01 07:14:15.149670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:15 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:15.151490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47d10ad5-df02-4dc9-bc1d-9f929baabb3f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:15.277311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-47d10ad5-df02-4dc9-bc1d-9f929baabb3f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:15.291717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47d10ad5-df02-4dc9-bc1d-9f929baabb3f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1220 microversion: 2.1 time: 0.157406 Sep 01 07:14:15.292416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 9/18] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:15 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:16.167800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:16.169099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:16.175744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:16.176530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:16.177221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:16.178145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:16.179343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:16.180591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:16.324195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:16.326624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:16.353025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:16.353817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:16.354262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:16.354971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:16.355902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:16.356326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:16.403613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:16.420843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-216970fb-5eaf-48c6-885e-10d5094fbab7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1218 microversion: 2.1 time: 0.257204 Sep 01 07:14:16.423864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 10/19] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:16 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:16.812925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:16.840325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25ace6ee-8607-40a5-852d-a6aa7e3ea0e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1224 microversion: 2.1 time: 0.523546 Sep 01 07:14:16.844468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 10/20] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:16 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1224 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:17.445057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:17.446431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:17.467902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:17.473437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:17.476067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:17.477099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:17.483896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:17.484618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:17.837798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:17.865443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:17.866064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:17.872790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1a134ee-6b6d-4767-8bc9-c8c87374b0bd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1266 microversion: 2.1 time: 0.420293 Sep 01 07:14:17.893494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 11/21] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:17 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1266 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:17.896436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:17.898588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:17.899268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:17.901059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:17.901667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:17.902698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:18.089851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7bf1963-287c-45e4-bc23-2400a187722e tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78cf706040>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:18.107287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:18.147597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-377b91bd-1b54-4a1a-becb-4845cfb554b4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1272 microversion: 2.1 time: 0.282442 Sep 01 07:14:18.153231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 11/22] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:17 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:18.255355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7bf1963-287c-45e4-bc23-2400a187722e tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d7651b7e-9aff-48b4-addf-b49f9e6a60f8" status: 200 len: 351 microversion: 2.1 time: 0.170085 Sep 01 07:14:18.257836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:14:18 2022] GET /compute/v2.1/os-volumes/d7651b7e-9aff-48b4-addf-b49f9e6a60f8 => generated 351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:18.272227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51e444c9-1b7d-4cfe-9e6e-81158a861d4b tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78cf712ca0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:18.581273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51e444c9-1b7d-4cfe-9e6e-81158a861d4b tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.314825 Sep 01 07:14:18.584460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Sep 1 07:14:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:18.607954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a133db9d-05e5-4579-902a-8959f9718296 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78cf6acee0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:18.688843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-187918300", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de2b3597-56ee-48e1-b75b-557a6c9a793f"}], "security_groups": [{"name": "tempest-securitygroup--1733767167"}], "key_name": "tempest-keypair-1204319312", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:18.937533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a133db9d-05e5-4579-902a-8959f9718296 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.342967 Sep 01 07:14:18.938414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Sep 1 07:14:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:14:18.944665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:18.945582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:18.972273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:18.982499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:18.985366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:18.988960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:18.990751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:18.992391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:19.288105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:19.305055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3393c78-98d1-4931-a07c-874c816f9cad tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1274 microversion: 2.1 time: 0.363410 Sep 01 07:14:19.308476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 14/26] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:18 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1274 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:19.327196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0a7a6e4-37ed-42da-8ae5-d0e499e67439 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78cf706670>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:19.439413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] validate_networks() for [('de2b3597-56ee-48e1-b75b-557a6c9a793f', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:14:19.688039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0a7a6e4-37ed-42da-8ae5-d0e499e67439 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.377501 Sep 01 07:14:19.689083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 15/27] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Sep 1 07:14:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:19.696029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:19.696936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:19.722727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:19.723571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:19.724440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:19.725364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:19.728234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:19.728922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:20.240643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:20.254033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ebb841b5-a1ec-498e-9c70-940ed7900989 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1278 microversion: 2.1 time: 0.562170 Sep 01 07:14:20.254898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 16/28] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:19 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1278 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:20.280887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36c346e1-5271-47e2-b19a-773fdf946298 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78cf6fbb80>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:20.583801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36c346e1-5271-47e2-b19a-773fdf946298 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.313418 Sep 01 07:14:20.584916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 17/29] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Sep 1 07:14:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:20.592194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:20.592194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:20.607958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:20.608704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:20.609371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:20.610174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:20.610726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:20.612416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:20.887208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:20.897476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1867c21a-fda0-4bf0-b4c2-341775fe3974 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1272 microversion: 2.1 time: 0.311008 Sep 01 07:14:20.902892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 18/30] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:20 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:20.921254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19122a19-48d6-4e4f-8870-575bef643e3d tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78d01041f0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:21.309237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19122a19-48d6-4e4f-8870-575bef643e3d tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.391380 Sep 01 07:14:21.310333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 19/31] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Sep 1 07:14:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:21.316451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:21.322170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:21.355025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:21.355917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:21.360924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:21.361972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:21.362595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:21.365954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:21.762648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:21.774765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-931c93fa-e2f5-4c82-bfaf-d13fa94d26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1278 microversion: 2.1 time: 0.460319 Sep 01 07:14:21.775567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 20/32] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:21 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1278 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:21.795357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5552d40c-9182-4e1d-8ab8-9f05811eff41 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78cf653b80>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:21.910590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5552d40c-9182-4e1d-8ab8-9f05811eff41 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.132596 Sep 01 07:14:21.911803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 21/33] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Sep 1 07:14:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:21.923562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:21.924176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:21.930435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:21.931086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:21.931609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:21.938054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:21.940871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:21.941722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:21.976351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:14:21.976937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:14:21.977371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:14:21.977922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:14:21.978565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:14:21.991568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:21.992068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:21.992508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:21.993261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:21.993717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:21.994141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:22.030474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Getting quotas for project e2774daeaf2945eea5b6f33ad4ea2bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:14:22.035364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Getting quotas for user 2096dd4d4b6f49fc8572a4bcd9689248 and project e2774daeaf2945eea5b6f33ad4ea2bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:14:22.051414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:22.062749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-205ed4bb-0b78-4c57-ae7d-e2a6ed13242e tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1272 microversion: 2.1 time: 0.142295 Sep 01 07:14:22.064009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 22/34] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:21 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:22.071423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:14:22.074979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:14:22.090046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b29e988-5d06-4d10-98f6-70c737524f12 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78cf6fbb80>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:22.198018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c86f50ee-354b-488b-bb98-2a7b23b9f577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.514807 Sep 01 07:14:22.206664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 13/35] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Sep 1 07:14:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 3520 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 07:14:22.215126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36127bc5-ffa8-49f2-88e0-f3dee755422a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:22.220266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36127bc5-ffa8-49f2-88e0-f3dee755422a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:22.314238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b29e988-5d06-4d10-98f6-70c737524f12 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.248789 Sep 01 07:14:22.314816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 23/36] 10.222.0.46 () {58 vars in 1188 bytes} [Thu Sep 1 07:14:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:22.341265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6abf338-b4cd-46fd-a51a-f6d8a202c850 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] Calling method '.version_select at 0x7f78cf653790>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:22.424613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36127bc5-ffa8-49f2-88e0-f3dee755422a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:22.438123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36127bc5-ffa8-49f2-88e0-f3dee755422a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:22.444367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36127bc5-ffa8-49f2-88e0-f3dee755422a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:22.450304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36127bc5-ffa8-49f2-88e0-f3dee755422a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1281 microversion: 2.20 time: 0.241449 Sep 01 07:14:22.454517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 14/37] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:14:22.519808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6abf338-b4cd-46fd-a51a-f6d8a202c850 tempest-VolumesTestJSON-79664615 tempest-VolumesTestJSON-79664615-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.187737 Sep 01 07:14:22.521246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 24/38] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Sep 1 07:14:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:22.796244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:22.797672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:22.813111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:22.814368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:22.818458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:22.819421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:22.820060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:22.820667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:23.102793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:23.104828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:23.146169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:23.148597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:23.149539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:23.153334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:23.156391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:23.158935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:23.209955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:23.574120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:23.605927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1d8650fe-dd99-4417-93dd-1360bf9ffc0c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.813539 Sep 01 07:14:23.610019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 15/39] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:22 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:23.634204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:23.638232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:23.663155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:23.665435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:23.667164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:23.668708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:23.670789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:23.674596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:23.834354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:23.852073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a568ea9e-5bd2-497c-a56b-6078437b6443 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.769793 Sep 01 07:14:23.868195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 25/40] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:23 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:23.983233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:24.011218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:24.012834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:24.014270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed627166-2dc6-4ce7-852a-bf9a1dbe39f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1277 microversion: 2.20 time: 0.398434 Sep 01 07:14:24.026484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 16/41] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1277 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:24.637196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:24.638503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:24.653833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:24.656447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:24.659377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:24.660878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:24.667713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:24.669218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:24.880451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:24.882126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:24.913650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:24.914145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:24.914583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:24.915285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:24.922593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:24.923264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:25.050382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:25.061887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5230371c-63f6-48b3-ae19-c49f2c494087 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.431138 Sep 01 07:14:25.077540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 26/42] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:24 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:25.083332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:25.084328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:25.091383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:25.092145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:25.092789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:25.093711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:25.094319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:25.094894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:25.141230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=14 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:25.196455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:25.210052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:25.217792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:25.219109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-69b5fbd1-b43b-41c5-b3e8-13cff32f95e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1333 microversion: 2.20 time: 0.140135 Sep 01 07:14:25.219968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 27/43] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1333 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:25.334476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:25.354287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0b93539-796b-47fe-a41f-85c52ebfd249 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.477430 Sep 01 07:14:25.366573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 17/44] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:24 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:26.099418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:26.101205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:26.119868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:26.133415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:26.135648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:26.137515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:26.138488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:26.139716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:26.244828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:26.245937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:26.263167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:26.263450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:26.267628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:26.268364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:26.268819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:26.273599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:26.630163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:26.671698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:26.673168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:26.674316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1cbcbe7-4aa0-49dd-90c1-6cc0db78f782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1341 microversion: 2.20 time: 0.433321 Sep 01 07:14:26.674973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 18/45] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1341 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:26.718970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:26.724205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:26.776568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:26.780806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:26.781621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:26.783382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:26.784203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:26.785218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:27.273312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:27.286802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-655b26c0-0853-4a2b-9d0b-9efb1b7f220b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 1.203404 Sep 01 07:14:27.290013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 28/46] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:26 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:27.512905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:27.523207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9eb8ffce-3191-4b8d-9de1-d378aab7649b tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.847210 Sep 01 07:14:27.523790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 19/47] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:26 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:27.637189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-90ba8d0c-18ff-4443-bce3-f57126ad359e req-89b8e9ec-34d1-4d65-85a7-ad472feac385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9104a7a7-e214-4212-b2c8-d7a1d5b35aee", "tag": "715132fd-b763-4529-ae40-a063895f7aaf"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:27.651335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-90ba8d0c-18ff-4443-bce3-f57126ad359e req-89b8e9ec-34d1-4d65-85a7-ad472feac385 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:27.652299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-90ba8d0c-18ff-4443-bce3-f57126ad359e req-89b8e9ec-34d1-4d65-85a7-ad472feac385 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:27.653085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-90ba8d0c-18ff-4443-bce3-f57126ad359e req-89b8e9ec-34d1-4d65-85a7-ad472feac385 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:27.675898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-90ba8d0c-18ff-4443-bce3-f57126ad359e req-89b8e9ec-34d1-4d65-85a7-ad472feac385 service nova] Creating event network-changed:715132fd-b763-4529-ae40-a063895f7aaf for instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee on hv-cinder-73306 Sep 01 07:14:27.676468 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-90ba8d0c-18ff-4443-bce3-f57126ad359e req-89b8e9ec-34d1-4d65-85a7-ad472feac385 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 07:14:27.676864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-90ba8d0c-18ff-4443-bce3-f57126ad359e req-89b8e9ec-34d1-4d65-85a7-ad472feac385 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 07:14:27.678068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:27.678762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:27.679404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:27.680324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:27.680963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:27.681635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:27.693328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.compute.rpcapi [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 07:14:27.694456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] Releasing lock "compute-rpcapi-router" {{(pid=120638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 07:14:27.705672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:27.706610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:27.718170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:27.719201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:27.720579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:27.723240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:27.723961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:27.726104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c9e4ef1-6219-45f3-86b3-13c0123df656 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159777 Sep 01 07:14:27.726792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:27.729320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 29/48] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:27.829647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:27.842484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:27.844859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:27.846628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-623732da-d29a-412b-9fa9-784b2e42be3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.149027 Sep 01 07:14:27.848628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 20/49] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:28.313103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:28.314101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:28.322667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:28.323167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:28.323620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:28.324329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:28.324780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:28.329463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:28.423050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-f7c53e23-0f60-45ff-9792-6372628da0b1 req-26748d9d-b573-4be0-b5af-65d34235e34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7a26b0-4589-467a-96a8-d9caeb697915", "tag": "214057a5-5b50-419f-915c-819a8579477e"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:28.439026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f7c53e23-0f60-45ff-9792-6372628da0b1 req-26748d9d-b573-4be0-b5af-65d34235e34c service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:28.441885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f7c53e23-0f60-45ff-9792-6372628da0b1 req-26748d9d-b573-4be0-b5af-65d34235e34c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:28.442598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f7c53e23-0f60-45ff-9792-6372628da0b1 req-26748d9d-b573-4be0-b5af-65d34235e34c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:28.472649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-f7c53e23-0f60-45ff-9792-6372628da0b1 req-26748d9d-b573-4be0-b5af-65d34235e34c service nova] Creating event network-changed:214057a5-5b50-419f-915c-819a8579477e for instance aa7a26b0-4589-467a-96a8-d9caeb697915 on hv-cinder-73306 Sep 01 07:14:28.480550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-f7c53e23-0f60-45ff-9792-6372628da0b1 req-26748d9d-b573-4be0-b5af-65d34235e34c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246075 Sep 01 07:14:28.481836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 30/50] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:14:28.545823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:28.546620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:28.567335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:28.568977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:28.570784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:28.573028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:28.573731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:28.576412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:28.613571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:28.626626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3020179d-c636-4552-bac5-dbfb27a85aee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.317563 Sep 01 07:14:28.627298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 21/51] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:28 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:28.746600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:28.764835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a8e1ee5-452f-40e7-a547-b55b5fede9a1 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.224513 Sep 01 07:14:28.765444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 31/52] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:28 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:28.878947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:28.879859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:28.887212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:28.887733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:28.888215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:28.889072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:28.889618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:28.890032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:28.954851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:28.965476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:28.967016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:28.968206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ebfd2457-ee63-4ab6-ba70-a5d57dbe04d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.093615 Sep 01 07:14:28.969149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 22/53] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:29.647875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:29.648595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:29.655374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:29.656090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:29.656674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:29.657473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:29.657968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:29.658598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:29.788391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:29.789657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:29.800403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:29.805038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:29.806499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:29.809373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:29.810053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:29.810663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:29.840530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:29.880281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f60656c6-1411-45b0-9585-ce6d289644f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.236434 Sep 01 07:14:29.881201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 32/54] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:29 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:29.995117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:29.996105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:30.010829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:30.012081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:30.013815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:30.016508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:30.017319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:30.017996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:30.069608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:30.081638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2fd2a62-dbb9-4a92-a43e-b21d71fd04ec tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.293917 Sep 01 07:14:30.082269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 23/55] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:29 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:30.148362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:30.158676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:30.162010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:30.163353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5072dca8-f88f-48a0-8019-7464aed6bb60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.174634 Sep 01 07:14:30.178688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 33/56] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:30.509033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c6424ea0-6635-4ea0-b7d2-34a2bad6548e req-2eea9876-e5f8-420a-9421-f17afaf1aa0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807e6a8a-bf4f-4892-b8e8-4039c7e96411", "tag": "f1cd3379-d126-426f-a22a-2cd95d74fd87"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:30.537069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c6424ea0-6635-4ea0-b7d2-34a2bad6548e req-2eea9876-e5f8-420a-9421-f17afaf1aa0a service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:30.537818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c6424ea0-6635-4ea0-b7d2-34a2bad6548e req-2eea9876-e5f8-420a-9421-f17afaf1aa0a service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:30.538444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c6424ea0-6635-4ea0-b7d2-34a2bad6548e req-2eea9876-e5f8-420a-9421-f17afaf1aa0a service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:30.617244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c6424ea0-6635-4ea0-b7d2-34a2bad6548e req-2eea9876-e5f8-420a-9421-f17afaf1aa0a service nova] Creating event network-changed:f1cd3379-d126-426f-a22a-2cd95d74fd87 for instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 on hv-cinder-73306 Sep 01 07:14:30.623095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c6424ea0-6635-4ea0-b7d2-34a2bad6548e req-2eea9876-e5f8-420a-9421-f17afaf1aa0a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 07:14:30.625942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c6424ea0-6635-4ea0-b7d2-34a2bad6548e req-2eea9876-e5f8-420a-9421-f17afaf1aa0a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 07:14:30.643017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:30.647008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:30.649281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:30.652680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:30.654755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:30.655370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:30.677142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.compute.rpcapi [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 07:14:30.683408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] Releasing lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 07:14:30.730016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4fec55b5-33be-4623-9262-3158cc34b352 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228277 Sep 01 07:14:30.732620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 24/57] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:30.928769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:30.930173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:30.948492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:30.950378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:30.951127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:30.953363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:30.953823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:30.954253 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:31.112276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:31.112983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:31.116705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:31.132387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:31.134957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:31.135935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:31.138074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:31.140432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:31.140976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:31.260181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:31.270758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e087156e-852c-45c6-9b65-428a9033fddb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.355538 Sep 01 07:14:31.273014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 34/58] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:30 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:31.300264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:31.301087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:31.312261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:31.322826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:31.323615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:31.325941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:31.330959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:31.332164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:31.346971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:31.482989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:31.492064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:31.496750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:31.499701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37cc5d87-ba01-4bd8-b253-0e04aac2361f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.223262 Sep 01 07:14:31.509992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 35/59] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:31.577599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:31.599829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-90a46b97-0999-4e7f-bed9-2962a7b3892a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.492980 Sep 01 07:14:31.618915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 25/60] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:31 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:32.309174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:32.310517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:32.317643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:32.318674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:32.319290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:32.320199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:32.320760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:32.321443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:32.524894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:32.540483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:32.548345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:32.554441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=24 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:32.558758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b56685a-e903-4c19-ac7f-a0e2dbe4d355 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.258450 Sep 01 07:14:32.573906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 36/61] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:32 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:32.580229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:32.581528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:32.582183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:32.583133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:32.583997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:32.585240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:32.626782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:32.627409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:32.641324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:32.641884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:32.643479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:32.644866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:32.650303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:32.650861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:32.672739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:32.705183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:32.708481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:32.713924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-919a1805-c947-4171-aa2b-2d2ac9a798ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.182567 Sep 01 07:14:32.718958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 26/62] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:33.208652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:33.217632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4daa303-cd8e-4b88-817a-2c061ea4cf6a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.595025 Sep 01 07:14:33.218693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 37/63] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:32 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:33.582548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:33.583483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:33.591215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:33.593224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:33.594911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:33.595635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:33.596103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:33.596834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:33.746794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:33.747633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:33.758286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:33.758723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:33.759209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:33.760250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:33.769860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:33.769860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:33.805309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:33.827139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16267005-b1c1-45bb-86b1-34dc371f1015 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.248587 Sep 01 07:14:33.827746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 27/64] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:33 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:33.882128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:33.890355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:33.891890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:33.893088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-257b2cb7-218f-4372-b5d6-d9626c0dc446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.152167 Sep 01 07:14:33.894129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 38/65] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:34.238450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:34.239097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:34.245006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:34.245913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:34.246603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:34.247489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:34.248071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:34.248652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:34.392084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:34.395462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:34.400311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74011cff-5c77-4eca-a60d-2730f858ac66 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.165602 Sep 01 07:14:34.400889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 28/66] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:34 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:34.850196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:34.851609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:34.858577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:34.859337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:34.859992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:34.860920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:34.861713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:34.862344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:34.917445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:34.918400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:34.926154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:34.926772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:34.927312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:34.928129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:34.928678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:34.929237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:35.020766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:35.030981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:35.034107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:35.035290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e352ee9-d85b-4904-9295-bbf01cfa76e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.122298 Sep 01 07:14:35.035880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 29/67] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:14:35.071626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:35.082103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53a3933f-fc57-434c-93c4-1fbc150ead1e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.237309 Sep 01 07:14:35.085494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 39/68] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:34 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:35.422706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:35.423474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:35.431601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:35.432341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:35.433031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:35.433859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:35.434548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:35.435061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:35.582293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:35.590339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-550181d9-5647-4b63-bf68-165cd4635b24 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.172917 Sep 01 07:14:35.591118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 30/69] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:35 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:36.068859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:36.070640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:36.072993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:36.088085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:36.090862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:36.091542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:36.092469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:36.093160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:36.093787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:36.110221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:36.112130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:36.120946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:36.121594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:36.122062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:36.123014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:36.123903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:36.124388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:36.356300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:36.374503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:36.376896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:36.390842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5ea32e62-aa71-4f94-9bf4-f504b436452c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.328824 Sep 01 07:14:36.394248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 40/70] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:36.612641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:36.613397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:36.626920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:36.627675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:36.628242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:36.629796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:36.630611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:36.631456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:36.917836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:36.929310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00fed530-d487-4d0b-a061-e6b5a1cdab10 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.826694 Sep 01 07:14:36.932437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 31/71] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:36 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:37.418503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:37.419393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:37.433495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:37.434535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:37.434981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:37.439494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:37.440041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:37.440878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:37.689710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:37.714548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:37.741310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:37.748749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:37.750267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5fcdb57f-352d-4e1e-9b6f-57ef1c9d9b6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.337686 Sep 01 07:14:37.762349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 32/72] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:14:37.797942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:37.818576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-80f3b407-6c07-4c72-94aa-568c14c71599 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 1.209792 Sep 01 07:14:37.833909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 41/73] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:36 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:37.953427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:37.954986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:37.971354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:37.972077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:37.972800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:37.974529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:37.975133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:37.975777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:38.776057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:38.777260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:38.789071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:38.790556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:38.797723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:38.798491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:38.798963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:38.799542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:38.966570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:38.970865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:38.976370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1fd98b2f-5164-4955-bbcf-b1af7e8f49f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 1.026655 Sep 01 07:14:38.987952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 33/74] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:37 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:38.989174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:38.990725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:38.992388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d3f66663-3acc-4e80-a227-926a1a078020 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1339 microversion: 2.20 time: 0.220157 Sep 01 07:14:38.992936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 42/75] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1339 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:14:38.996429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:38.997080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:39.003377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:39.004079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:39.004735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:39.005651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:39.006555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:39.007188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:39.217317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:39.228307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-288580a2-8cc9-4ae3-ac5f-c7fb68e17d7c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.235054 Sep 01 07:14:39.245896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 34/76] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:38 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:40.000504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:40.001370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:40.008631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:40.009337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:40.015824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:40.017192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:40.024709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:40.025719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:40.027595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:40.028087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:40.028513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:40.029166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:40.029765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:40.035040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:40.037003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:40.037980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:40.276060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:40.285742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:40.297597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fcff3401-99ae-4058-b202-a879ad89c0bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.300640 Sep 01 07:14:40.297942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:40.299030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 43/77] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:39 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:40.300632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:40.302481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee38a379-a273-4135-8902-bbc31382dd3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.291861 Sep 01 07:14:40.303047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 35/78] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:14:40.315215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:40.317758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:40.336645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:40.339243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:40.340359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:40.342490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:40.344740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:40.346639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:40.572132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:40.580447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3e5f0ff9-cf93-457a-8ec5-6ffc3aa9c1f9 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.280412 Sep 01 07:14:40.581012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 44/79] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:40 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:41.319502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:41.320036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:41.322068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:41.327599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:41.328076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:41.328505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:41.329212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:41.329536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:41.329961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:41.330043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:41.330189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:41.347595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:41.349054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:41.349734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:41.350536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:41.351176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:41.351644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:41.629684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:41.645969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c71b8914-9519-45cf-9254-891c42ce2c4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.322135 Sep 01 07:14:41.646594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 36/80] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:41 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:41.651253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:41.652298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:41.672065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:41.673563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:41.674214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:41.675105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:41.675725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:41.676376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:41.725174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:41.736103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:41.739691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:41.740967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ab9549d-cc7c-4e6d-9cfb-60630104a5a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.420308 Sep 01 07:14:41.743678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 45/81] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:14:42.315549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:42.330597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3cd55836-de37-4eb5-bac2-45085deb7d39 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.682408 Sep 01 07:14:42.334760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 37/82] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:41 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:42.670776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:42.671439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:42.679936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:42.680895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:42.681511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:42.682632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:42.683964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:42.685483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:42.767803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:42.769279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:42.777207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:42.777856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:42.778300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:42.778998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:42.779646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:42.780249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:42.924587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:42.938279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30dd8f12-d9a7-4142-9071-dda505503942 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.272754 Sep 01 07:14:42.939117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 46/83] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:42 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:42.946173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-895ffdf3-7b94-49a1-8e75-302940630259 req-ca9429cf-4481-40e4-a0ca-12d5cc499090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179bc01d-7bec-423c-8b0f-170bfa0d6ab0", "tag": "a391aacc-abe6-4876-aa12-6c9d9b026042"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:42.957825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-895ffdf3-7b94-49a1-8e75-302940630259 req-ca9429cf-4481-40e4-a0ca-12d5cc499090 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:42.958858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-895ffdf3-7b94-49a1-8e75-302940630259 req-ca9429cf-4481-40e4-a0ca-12d5cc499090 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:42.959759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-895ffdf3-7b94-49a1-8e75-302940630259 req-ca9429cf-4481-40e4-a0ca-12d5cc499090 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:42.978093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-895ffdf3-7b94-49a1-8e75-302940630259 req-ca9429cf-4481-40e4-a0ca-12d5cc499090 service nova] Creating event network-changed:a391aacc-abe6-4876-aa12-6c9d9b026042 for instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 on hv-cinder-73306 Sep 01 07:14:42.988205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-895ffdf3-7b94-49a1-8e75-302940630259 req-ca9429cf-4481-40e4-a0ca-12d5cc499090 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047637 Sep 01 07:14:42.989432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 47/84] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:43.033340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:43.047587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:43.049032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:43.050364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d4d789c6-8c8d-4b8a-9b16-8cd749dae25b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.286840 Sep 01 07:14:43.051495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 38/85] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:43.360848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:43.361799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:43.372343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:43.374554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:43.376978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:43.380068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:43.384188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:43.384657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:43.963288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:43.963992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:43.975372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:43.976660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:43.977595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:43.979210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:43.979875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:43.984119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:44.436203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:44.455787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e0432575-ef8d-4b7c-81bb-e0ea9ffd9942 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 1.101472 Sep 01 07:14:44.456951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 48/86] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:43 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:44.462266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:44.463141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:44.470569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:44.472510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:44.473730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:44.482114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:44.482914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:44.483555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:44.798860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:44.810315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5168c413-5ab1-4f2d-949b-50b2ebacb4d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.852236 Sep 01 07:14:44.813229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 39/87] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:43 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:44.996786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:45.009193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:45.011071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:45.012495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81245f4b-1168-454e-ae9e-157c72c0c038 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.553919 Sep 01 07:14:45.017853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 49/88] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:45.480659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:45.481362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:45.494301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:45.494798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:45.495234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:45.495948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:45.496391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:45.497085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:45.696895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:45.709816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e49a382-0c12-4be6-8b3d-f9f719ef16b4 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.234430 Sep 01 07:14:45.712807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 40/89] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:45 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:45.831828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:45.832963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:45.843812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:45.844714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:45.846195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:45.850413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:45.851087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:45.853283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:46.039524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:46.040299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:46.050076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:46.051877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:46.052325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:46.054273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:46.054733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:46.058048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:46.104706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:46.114894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0a40ebf5-1c19-4f60-b58b-e7f8c38e1c55 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.286865 Sep 01 07:14:46.125497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 50/90] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:45 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:46.268011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:46.279563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:46.281262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:46.282655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9b1377c-f806-47f8-8e27-9ab16ac81d05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.249596 Sep 01 07:14:46.284372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 41/91] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:46.735735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:46.736349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:46.743364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:46.743844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:46.744266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:46.744953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:46.745782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:46.746098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:47.012000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:47.022517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-04752efe-9c93-4dba-89c7-db9724338c9a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.292429 Sep 01 07:14:47.025071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 51/92] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:46 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:47.138188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:47.138877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:47.149556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:47.150444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:47.152894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:47.155145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:47.156542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:47.157310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:47.307797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:47.308706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:47.317021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:47.324156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:47.324987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:47.325839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:47.326483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:47.326929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:47.372383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:47.533052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:47.546662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4e5e00c-c622-4d30-a21f-09249b9d981e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.412775 Sep 01 07:14:47.547554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 42/93] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:47 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:47.700022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:47.717433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:47.725239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:47.729590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a974383-e5a1-4490-b0fa-dda6599998be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.425577 Sep 01 07:14:47.741508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 52/94] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:48.053036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:48.054074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:48.065821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:48.066600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:48.067042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:48.067900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:48.068539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:48.069171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:48.311311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:48.327051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22dc56c1-965b-4e2b-bd1a-eb8b7184e6a6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.280474 Sep 01 07:14:48.331921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 43/95] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:48 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:48.568014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:48.568627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:48.576931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:48.577768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:48.578652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:48.579513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:48.580113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:48.580851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:48.686956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-6ec8935f-effd-4eb5-92fb-e2ea4dc10f95 req-ad90a043-662d-4de5-a3ff-c33567f8c3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7a26b0-4589-467a-96a8-d9caeb697915", "name": "network-vif-plugged", "status": "completed", "tag": "214057a5-5b50-419f-915c-819a8579477e"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:48.696922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6ec8935f-effd-4eb5-92fb-e2ea4dc10f95 req-ad90a043-662d-4de5-a3ff-c33567f8c3c0 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:48.697681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6ec8935f-effd-4eb5-92fb-e2ea4dc10f95 req-ad90a043-662d-4de5-a3ff-c33567f8c3c0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:48.698325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6ec8935f-effd-4eb5-92fb-e2ea4dc10f95 req-ad90a043-662d-4de5-a3ff-c33567f8c3c0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:48.711690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6ec8935f-effd-4eb5-92fb-e2ea4dc10f95 req-ad90a043-662d-4de5-a3ff-c33567f8c3c0 service nova] Creating event network-vif-plugged:214057a5-5b50-419f-915c-819a8579477e for instance aa7a26b0-4589-467a-96a8-d9caeb697915 on hv-cinder-73306 Sep 01 07:14:48.717400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-6ec8935f-effd-4eb5-92fb-e2ea4dc10f95 req-ad90a043-662d-4de5-a3ff-c33567f8c3c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313378 Sep 01 07:14:48.718488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 53/96] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:48.774749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:48.775288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:48.800223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:48.800733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:48.801814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:48.801954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:48.803028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:48.804745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:48.868573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:48.877388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13279a86-cc43-4f5e-856c-e1a1eb17360e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.313647 Sep 01 07:14:48.877957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 44/97] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:48 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:49.118195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:49.130240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:49.131961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:49.141402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5aa1afc7-1041-43f6-b0e8-542e62ad13a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.379088 Sep 01 07:14:49.141916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 54/98] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:14:49.355012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:49.356187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:49.388999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:49.391885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:49.393057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:49.394030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:49.395736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:49.397563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:49.455073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:14:49.618311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:49.628162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3e8606c-3926-49db-b1f9-b54f61571157 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.277812 Sep 01 07:14:49.629381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 45/99] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:49 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:49.904250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:49.905169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:49.913904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:49.914558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:49.915129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:49.915850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:49.916305 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:49.917000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:50.106798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:50.115082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7518135-32ba-4b17-ac83-bfa3fb8aebdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.216921 Sep 01 07:14:50.124902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 55/100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:49 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:50.165270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:50.166476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:50.174292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:50.175668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:50.176312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:50.177313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:50.177916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:50.178556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:50.373877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:50.393371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:50.393371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:50.393371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75321fe7-69e3-4e97-923d-8f3147d9b605 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.227208 Sep 01 07:14:50.394191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 46/101] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:50.652248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:50.653945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:50.670198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:50.672253 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:50.673414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:50.675383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:50.677288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:50.682234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:50.750182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-26aa86f8-fcfa-401a-aa63-93edce4fdc1c req-a65c44f9-3b55-4aae-b262-ee029a477b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104a7a7-e214-4212-b2c8-d7a1d5b35aee", "name": "network-vif-plugged", "status": "completed", "tag": "715132fd-b763-4529-ae40-a063895f7aaf"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:50.791130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-26aa86f8-fcfa-401a-aa63-93edce4fdc1c req-a65c44f9-3b55-4aae-b262-ee029a477b47 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:50.793428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-26aa86f8-fcfa-401a-aa63-93edce4fdc1c req-a65c44f9-3b55-4aae-b262-ee029a477b47 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:50.793893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-26aa86f8-fcfa-401a-aa63-93edce4fdc1c req-a65c44f9-3b55-4aae-b262-ee029a477b47 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:50.842728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-26aa86f8-fcfa-401a-aa63-93edce4fdc1c req-a65c44f9-3b55-4aae-b262-ee029a477b47 service nova] Creating event network-vif-plugged:715132fd-b763-4529-ae40-a063895f7aaf for instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee on hv-cinder-73306 Sep 01 07:14:50.851561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-26aa86f8-fcfa-401a-aa63-93edce4fdc1c req-a65c44f9-3b55-4aae-b262-ee029a477b47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105262 Sep 01 07:14:50.853103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 47/102] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:14:50.985472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:50.994827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c043404-8ee9-4f71-983f-ae8f5725b397 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.347629 Sep 01 07:14:50.995669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 56/103] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:50 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:51.137819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:51.138607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:51.149630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:51.150329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:51.151721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:51.152676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:51.153319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:51.153917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:51.349466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:51.357594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56a0efed-ad3b-494c-99a2-6000a8c3502b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1320 microversion: 2.1 time: 0.224460 Sep 01 07:14:51.372679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 48/104] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:51 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:51.411978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:51.412776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:51.418920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:51.419746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:51.420569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:51.421495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:51.422176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:51.422884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:51.681156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:51.689602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:51.699589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:51.705888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-09afcbe1-6db4-47d8-adb8-40abceed96cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.298258 Sep 01 07:14:51.709724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 57/105] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:52.015693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:52.016308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:52.027878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:52.028694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:52.029306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:52.030188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:52.030815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:52.031413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:52.316036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:52.336422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b37c32f0-fc87-4780-ad28-ab3ad98c61db tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1314 microversion: 2.1 time: 0.322746 Sep 01 07:14:52.339154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 49/106] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:52 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:52.388311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:52.390617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:52.402399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:52.403900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:52.406513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:52.407569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:52.408814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:52.409284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:52.733130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:52.733840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:52.754532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:52.757079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:52.757650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:52.758525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:52.762990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:52.765393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:52.765897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:52.777774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7aea1e15-55d5-4865-815e-cf56e94bf23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1514 microversion: 2.1 time: 0.392924 Sep 01 07:14:52.779287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 58/107] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:52 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1514 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:52.803161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:52.805810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:52.813160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:52.813949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:52.814882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:52.816012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:52.817069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:52.817717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:52.890653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lazy-loading 'flavor' on Instance uuid aa7a26b0-4589-467a-96a8-d9caeb697915 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:14:53.065268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d919f0fe-2dc6-40c1-9339-f8c26c259234 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915/action" status: 200 len: 32 microversion: 2.1 time: 0.266702 Sep 01 07:14:53.071849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:53.072533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 59/108] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:14:52 2022] POST /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:14:53.085271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:53.086520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-6e17734c-bf1c-415b-a1e5-38b35695e6e5 req-4e5fbe17-0c80-484a-aa5e-b8a908a3e84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e6a8a-bf4f-4892-b8e8-4039c7e96411", "name": "network-vif-plugged", "status": "completed", "tag": "f1cd3379-d126-426f-a22a-2cd95d74fd87"}, {"server_uuid": "179bc01d-7bec-423c-8b0f-170bfa0d6ab0", "name": "network-vif-plugged", "status": "completed", "tag": "a391aacc-abe6-4876-aa12-6c9d9b026042"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:53.088235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:53.089822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-432ede2c-7856-4a2c-a733-e41a6731324e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.361640 Sep 01 07:14:53.091109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 50/109] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:53.099051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:53.100005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:53.111812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:53.112317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:53.113079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:53.113341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6e17734c-bf1c-415b-a1e5-38b35695e6e5 req-4e5fbe17-0c80-484a-aa5e-b8a908a3e84a service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:53.114638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:53.114992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6e17734c-bf1c-415b-a1e5-38b35695e6e5 req-4e5fbe17-0c80-484a-aa5e-b8a908a3e84a service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:53.115703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:53.116283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6e17734c-bf1c-415b-a1e5-38b35695e6e5 req-4e5fbe17-0c80-484a-aa5e-b8a908a3e84a service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:53.116497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:53.144319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6e17734c-bf1c-415b-a1e5-38b35695e6e5 req-4e5fbe17-0c80-484a-aa5e-b8a908a3e84a service nova] Creating event network-vif-plugged:f1cd3379-d126-426f-a22a-2cd95d74fd87 for instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 on hv-cinder-73306 Sep 01 07:14:53.148725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6e17734c-bf1c-415b-a1e5-38b35695e6e5 req-4e5fbe17-0c80-484a-aa5e-b8a908a3e84a service nova] Creating event network-vif-plugged:a391aacc-abe6-4876-aa12-6c9d9b026042 for instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 on hv-cinder-73306 Sep 01 07:14:53.157360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-6e17734c-bf1c-415b-a1e5-38b35695e6e5 req-4e5fbe17-0c80-484a-aa5e-b8a908a3e84a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078866 Sep 01 07:14:53.158288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 60/110] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:53.355107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:53.366813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:53.369249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:53.373359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8e5493d-cfd1-4d38-bf9c-1fc8cfe09028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.280902 Sep 01 07:14:53.374324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 51/111] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:53 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:53.384138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:53.384794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:53.385662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:53.386912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:53.387641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:53.388257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:53.543958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:53.552565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-21146278-004b-467f-ba35-64bfaa8fa835 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1502 microversion: 2.1 time: 0.194065 Sep 01 07:14:53.553279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 61/112] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:53 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:54.112482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:54.113221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:54.121008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:54.123310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:54.124198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:54.125729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:54.129250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:54.129990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:54.396664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:54.397418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:54.405586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:54.408550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:54.409288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:54.414661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:54.415385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:54.416465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:54.672679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:54.703105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:54.719769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:54.721857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76bb5db6-664d-43ab-96f8-9177a4cb32f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.324910 Sep 01 07:14:54.722809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 62/113] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:54 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:54.724635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:54.732139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-26b02443-d6a0-4822-8847-a0d3ca90ea36 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.623626 Sep 01 07:14:54.734187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 52/114] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:55.369203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eac64f69-b6a1-4d9a-926c-2dd20c67930d"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:55.372618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:55.382246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:55.383044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:55.383494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:55.384205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:55.384886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:55.385421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:55.744285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:55.745532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:55.754000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:55.755209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:55.755965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:55.756957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:55.757430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:55.757844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:55.921892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:55.932791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5d43cc0-fd90-420c-b947-ab7e76e2c92d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.192748 Sep 01 07:14:55.944167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 53/115] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:55 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:14:55.958201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:55.958325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:55.968052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:55.968544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:55.968975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:55.969710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:55.970154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:55.970564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:56.272142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:56.281157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:56.282802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:56.284010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2fa0c6cf-3f74-4a65-b2aa-edc2bfdbe4ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1407 microversion: 2.20 time: 0.338181 Sep 01 07:14:56.284936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 54/116] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:56.960858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:56.961533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:56.973270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:56.973922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:56.974385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:56.975412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:56.977970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:56.978441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:57.143123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a945cd1-e718-4a4a-822a-2164d9273ee6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "POST /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.785705 Sep 01 07:14:57.144390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 63/117] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:14:55 2022] POST /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee/os-volume_attachments => generated 194 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:14:57.167679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:57.186490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc793a3b-3f44-468c-9a43-bdd953579c90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.229694 Sep 01 07:14:57.187494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 55/118] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:56 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:57.307922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:57.308622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:57.316808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:57.317417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:57.317831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:57.318466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:57.318921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:57.319405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:57.588767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:57.596744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:57.598247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:57.599395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b88d2d4-7eb5-40f3-8291-d4881cf32aa9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1599 microversion: 2.20 time: 0.296578 Sep 01 07:14:57.599965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 64/119] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:14:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1599 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:14:57.631415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:57.632084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:57.638339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:57.638839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:57.639276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:57.640123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:57.640708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:57.641328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:57.773172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3499913d-925d-4c4e-ab9c-a16ac33d6d91 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.148688 Sep 01 07:14:57.782237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 56/120] 10.222.0.46 () {60 vars in 1316 bytes} [Thu Sep 1 07:14:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:14:58.207151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:58.207946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:58.214376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:58.214855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:58.215283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:58.215967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:58.216578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:58.217161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:58.416822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:58.425197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96813c85-5938-4456-9825-3bec1e7abf22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.221951 Sep 01 07:14:58.442026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 65/121] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:58 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:14:59.455534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:14:59.456215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:14:59.463651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:59.464221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:59.464716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:59.465499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:59.466006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:59.466504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:59.652581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-e259d8e1-47e0-414d-86a8-fb4b413eb2f5 req-28106b1c-9851-4570-b976-79c39c52e8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179bc01d-7bec-423c-8b0f-170bfa0d6ab0", "tag": "a391aacc-abe6-4876-aa12-6c9d9b026042"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:14:59.665556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e259d8e1-47e0-414d-86a8-fb4b413eb2f5 req-28106b1c-9851-4570-b976-79c39c52e8f8 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:14:59.666324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e259d8e1-47e0-414d-86a8-fb4b413eb2f5 req-28106b1c-9851-4570-b976-79c39c52e8f8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:14:59.666873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e259d8e1-47e0-414d-86a8-fb4b413eb2f5 req-28106b1c-9851-4570-b976-79c39c52e8f8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:14:59.682497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-e259d8e1-47e0-414d-86a8-fb4b413eb2f5 req-28106b1c-9851-4570-b976-79c39c52e8f8 service nova] Creating event network-changed:a391aacc-abe6-4876-aa12-6c9d9b026042 for instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 on hv-cinder-73306 Sep 01 07:14:59.685711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:14:59.688653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-e259d8e1-47e0-414d-86a8-fb4b413eb2f5 req-28106b1c-9851-4570-b976-79c39c52e8f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039673 Sep 01 07:14:59.689556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 66/122] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:14:59.695061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97bb44f0-8619-4f19-ae60-6522397eb734 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.244257 Sep 01 07:14:59.695621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 57/123] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:14:59 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:00.717531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:00.718794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:00.734438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:00.735238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:00.735905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:00.736825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:00.737539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:00.738548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:00.937763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:00.946811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:00.955441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-288f7077-ef78-433a-9531-541ba13aa599 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.243116 Sep 01 07:15:00.969653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 67/124] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:00 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:01.986434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:01.987820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:01.995844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=66 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:01.997235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:01.998021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:01.998431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:01.999218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:01.999665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:02.000078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:02.224524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:02.232676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4d1766b-2681-452a-b522-d4f1cdc76fa4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.253841 Sep 01 07:15:02.233315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 58/125] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:01 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:03.254411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:03.255034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:03.262790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:03.263280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:03.263719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:03.264415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:03.264867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:03.265324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:03.406291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:03.417001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8b1e1f92-a213-43e4-a0d3-9767c57710ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.167050 Sep 01 07:15:03.417717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 68/126] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:03 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:04.438042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:04.438627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:04.444548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:04.445015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:04.445473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:04.446144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:04.446589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:04.447043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:04.571072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:04.578596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af934b0e-2c4f-4661-bbe4-66fe14e8515f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.144317 Sep 01 07:15:04.579157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 59/127] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:04 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:05.598807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:05.599407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:05.606621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:05.607093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:05.607524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:05.608201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:05.608651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:05.609064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:05.764551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:05.774191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-979900c0-5f5e-4c4c-a628-cfeff1c901ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.178931 Sep 01 07:15:05.775349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 69/128] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:05 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:06.285236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-397234025", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:06.342782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] validate_networks() for None {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:15:06.614641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:15:06.615132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:15:06.615614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:15:06.616043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:15:06.616487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:15:06.625623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:06.626052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:06.626478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:06.627186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:06.627623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:06.628046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:06.646532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Getting quotas for project 8e9f3629cb0e4cf393ddf8942c5a6946. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:15:06.650422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Getting quotas for user 83123e2a0aaa4f17b2f3c7dd70572658 and project 8e9f3629cb0e4cf393ddf8942c5a6946. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:15:06.664657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:15:06.670664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:15:06.720631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ad7ba98-69a8-43dd-a5f2-1d222e726966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439061 Sep 01 07:15:06.721433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 60/129] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:15:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:15:06.731756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8cd734ca-3cd7-422f-89d7-c4d9518816da tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:06.732351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8cd734ca-3cd7-422f-89d7-c4d9518816da tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:06.761390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=60 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:06.813500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:06.814421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:06.823162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:06.824013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:06.825009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:06.827937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:06.828481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:06.838845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:06.853147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8cd734ca-3cd7-422f-89d7-c4d9518816da tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:06.862642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8cd734ca-3cd7-422f-89d7-c4d9518816da tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1214 microversion: 2.1 time: 0.133214 Sep 01 07:15:06.863432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 70/130] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:06 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:07.040292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:07.056262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4bde73b-0ede-47bb-8b31-319c4f7a235d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.250655 Sep 01 07:15:07.057267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 61/131] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:06 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:07.883953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:07.884789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:07.893833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:07.894314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:07.894776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:07.895458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:07.896445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:07.896904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:07.964628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:07.975140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f92ec1d7-99be-4ba6-a193-149653999e12 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1218 microversion: 2.1 time: 0.095341 Sep 01 07:15:07.993152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 71/132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:07 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:08.080312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:08.080926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:08.087895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:08.088542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:08.093362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:08.094283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:08.094966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:08.095648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:08.249401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:08.259249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-962cdd7f-2be9-45a8-8ef8-7de9397cb907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.183118 Sep 01 07:15:08.259535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 62/133] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:08 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:08.996881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:08.997560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:09.004855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:09.005481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:09.005927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:09.007094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:09.007593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:09.008009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:09.077480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:09.088143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eae3ef0f-8598-4bde-99d9-b2d3b9186cda tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1210 microversion: 2.1 time: 0.095279 Sep 01 07:15:09.088703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 72/134] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:08 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:09.283219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:09.284233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:09.291329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:09.291982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:09.292728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:09.293681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:09.294352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:09.294850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:09.296595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:09.297199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:09.306320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:09.307029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:09.307670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:09.308386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:09.308848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:09.309301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:09.335834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:15:09.427943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-39456cde-25b2-4d3e-95bc-89cd6163dcd7 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 204 len: 0 microversion: 2.1 time: 0.137018 Sep 01 07:15:09.428830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 73/135] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:15:09 2022] DELETE /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:15:09.438421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:09.439184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:09.444740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:09.445595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:09.446142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:09.446584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:09.447490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:09.447968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:09.448396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:09.450740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:09.454229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-405afa6d-6ae0-43f5-a1a9-1566e55ff060 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.174917 Sep 01 07:15:09.454953 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 63/136] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:09 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:09.577449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:09.586505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e444b29e-e545-41bb-8305-3a5fdcd65ffc tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1554 microversion: 2.1 time: 0.153523 Sep 01 07:15:09.587075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 74/137] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:09 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:10.110996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:10.111699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:10.120382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:10.120919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:10.121373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:10.122045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:10.122484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:10.122896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:10.188130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:10.196555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e5b699db-cac0-4a44-9f3e-25c0934bde20 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1274 microversion: 2.1 time: 0.090000 Sep 01 07:15:10.197187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 64/138] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:10 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:10.476203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:10.476872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:10.483626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:10.484109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:10.484541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:10.485257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:10.485704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:10.486118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:10.610234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:10.610919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:10.624563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:10.625058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:10.625522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:10.626227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:10.626674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:10.627130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:10.869552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:10.884640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5453c84-71a4-4745-a3f7-8c714ea65bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.411523 Sep 01 07:15:10.885323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 75/139] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:10 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:10.932808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:10.940894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70412d17-e396-42ea-8f79-5c35c6ecbfbd tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1554 microversion: 2.1 time: 0.337298 Sep 01 07:15:10.941479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 65/140] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:10 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:11.218206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:11.218734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:11.224524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:11.225055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:11.225552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:11.226239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:11.226694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:11.227111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:11.301997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:11.310892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e9545e0-0dfb-45f6-a3b0-98cb0f9a2b28 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1274 microversion: 2.1 time: 0.096489 Sep 01 07:15:11.311608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 76/141] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:11 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:11.906779 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:11.908128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:11.915825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:11.916451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:11.916973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:11.917787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:11.918478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:11.918987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:11.967298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:11.968939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:11.978481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:11.979309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:11.980588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:11.982804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:11.983623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:11.985023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:12.152819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:12.163531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79d7c806-8c75-4661-b5f6-a33ab52caba8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.261189 Sep 01 07:15:12.164167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 66/142] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:11 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:12.227379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:12.238570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1764cc1f-8a22-4301-bdda-81e106ec9ea3 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1554 microversion: 2.1 time: 0.280403 Sep 01 07:15:12.247625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 77/143] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:11 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:12.333703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:12.335439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:12.348846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:12.349478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:12.350067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:12.351383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:12.352658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:12.353304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:12.421422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:12.431945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-040d4eb8-719b-44c9-9bee-55c2673c0090 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1272 microversion: 2.1 time: 0.103533 Sep 01 07:15:12.432852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 67/144] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:12 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:13.190962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:13.192172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:13.201467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:13.202301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:13.203813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:13.204716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:13.205473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:13.206054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:13.269199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:13.270587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:13.277469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:13.277957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:13.278464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:13.279641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:13.280256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:13.280682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:13.592239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:13.602437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-32ffdd45-5ded-4390-b348-8b167af3f1ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.416470 Sep 01 07:15:13.603764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 78/145] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:13 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:13.608982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:13.609646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:13.617610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:13.618331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:13.618773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:13.619480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:13.620089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:13.620722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:13.789473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:13.799457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2a4d9627-61e3-4089-81aa-a5d093942e7d tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1554 microversion: 2.1 time: 0.535279 Sep 01 07:15:13.800290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 68/146] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:13 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1554 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:14.059587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:14.086507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-58a477ca-4b3a-4c89-bd9e-3b9a523f81fd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.481140 Sep 01 07:15:14.105489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 79/147] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:13 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:14.428130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-11bf5527-f0ae-46d9-8bf3-8ab899f10cdd req-b9f44c39-87e4-4fa9-b6d4-27c505ce7c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104a7a7-e214-4212-b2c8-d7a1d5b35aee", "name": "network-vif-deleted", "tag": "715132fd-b763-4529-ae40-a063895f7aaf"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:14.440517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-11bf5527-f0ae-46d9-8bf3-8ab899f10cdd req-b9f44c39-87e4-4fa9-b6d4-27c505ce7c82 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:14.440517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-11bf5527-f0ae-46d9-8bf3-8ab899f10cdd req-b9f44c39-87e4-4fa9-b6d4-27c505ce7c82 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:14.440696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-11bf5527-f0ae-46d9-8bf3-8ab899f10cdd req-b9f44c39-87e4-4fa9-b6d4-27c505ce7c82 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:14.454893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-11bf5527-f0ae-46d9-8bf3-8ab899f10cdd req-b9f44c39-87e4-4fa9-b6d4-27c505ce7c82 service nova] Creating event network-vif-deleted:715132fd-b763-4529-ae40-a063895f7aaf for instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee on hv-cinder-73306 Sep 01 07:15:14.460781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-11bf5527-f0ae-46d9-8bf3-8ab899f10cdd req-b9f44c39-87e4-4fa9-b6d4-27c505ce7c82 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037329 Sep 01 07:15:14.461887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 69/148] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:15:14.624078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:14.635003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:14.641651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:14.642340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:14.642769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:14.643482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:14.643939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:14.644365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:14.824411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:14.825588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:14.832751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:14.833346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:14.834023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:14.835348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:14.836435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:14.837271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:14.857784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:14.867811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbf990e7-e672-4e7a-b3c1-7c68319e3f0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.247754 Sep 01 07:15:14.868391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 80/149] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:14 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:14.905636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:14.913996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-090e344d-a600-48ed-b947-33aa38d7e7d6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1512 microversion: 2.1 time: 0.095406 Sep 01 07:15:14.914615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 70/150] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:14 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1512 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:15.119532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:15.120176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:15.126967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:15.127577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:15.128017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:15.128793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:15.129352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:15.129912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:15.264605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:15.272299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8de6394c-672f-4888-81b9-62690b3e09c8 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.157079 Sep 01 07:15:15.272869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 81/151] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:15 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:15.888147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:15.888754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:15.894784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:15.895266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:15.895698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:15.896381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:15.897358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:15.897788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:15.934865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:15.935479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:15.941811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:15.942303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:15.942746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:15.943443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:15.943969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:15.944408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:16.017734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:16.026419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c58ce129-036a-4ad3-b5c3-b7c6553995e6 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1512 microversion: 2.1 time: 0.095512 Sep 01 07:15:16.041300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 82/152] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:15 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1512 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:16.056536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:16.064014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32985135-da2f-405d-a720-7c9898640919 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.179637 Sep 01 07:15:16.064573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 71/153] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:15 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:16.293244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:16.293863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:16.300637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:16.301288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:16.301775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:16.302567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:16.303063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:16.304129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:16.431596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:16.435079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:16.439965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-841df176-fb40-40b2-a78d-3cf8100e32f0 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.150618 Sep 01 07:15:16.440526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 83/154] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:16 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:16.475558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-8a02d577-9ffd-4897-b215-0a7f34aa2228 req-78585dd7-8f32-4496-a0a8-2e214422401d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13a267d-8f48-4ea0-a8cf-7936cc113c92", "tag": "d12164dc-498a-41ed-a3b8-3789c71d40be"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:16.484532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8a02d577-9ffd-4897-b215-0a7f34aa2228 req-78585dd7-8f32-4496-a0a8-2e214422401d service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:16.485005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8a02d577-9ffd-4897-b215-0a7f34aa2228 req-78585dd7-8f32-4496-a0a8-2e214422401d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:16.485477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8a02d577-9ffd-4897-b215-0a7f34aa2228 req-78585dd7-8f32-4496-a0a8-2e214422401d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:16.496543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-8a02d577-9ffd-4897-b215-0a7f34aa2228 req-78585dd7-8f32-4496-a0a8-2e214422401d service nova] Creating event network-changed:d12164dc-498a-41ed-a3b8-3789c71d40be for instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 on hv-cinder-73306 Sep 01 07:15:16.501509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-8a02d577-9ffd-4897-b215-0a7f34aa2228 req-78585dd7-8f32-4496-a0a8-2e214422401d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029947 Sep 01 07:15:16.502101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 72/155] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:15:17.052307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:17.052938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:17.054700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:17.061562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:17.062047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:17.062483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:17.063169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:17.063725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:17.064157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:17.087889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:17.088553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:17.102741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:17.103429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:17.110756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:17.111246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:17.111676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:17.112369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:17.112817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:17.113259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:17.366032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:17.377244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aea7518f-8649-421f-9956-aa5ffad4fcf0 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1512 microversion: 2.1 time: 0.329292 Sep 01 07:15:17.377830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 84/156] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:17 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:17.462344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:17.462951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:17.468763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:17.469276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:17.469713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:17.470403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:17.470856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:17.471276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:17.646779 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:17.654634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9edfa07-473e-4197-8d8d-8f275d7e88e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.567697 Sep 01 07:15:17.655561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 73/157] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:17 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:17.820074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:17.830006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b818181b-f64d-4c15-9a83-ccc5e023beb4 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.371374 Sep 01 07:15:17.830609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 85/158] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:17 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:18.401650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:18.402402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:18.430540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:18.431174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:18.432919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:18.434016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:18.434649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:18.435175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:18.467193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:18.467842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:18.468414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:18.469203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lazy-loading 'fault' on Instance uuid 9104a7a7-e214-4212-b2c8-d7a1d5b35aee {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:18.554222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:18.563204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dca7b4a7-f083-4d56-9d65-b81f283c6e5a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1350 microversion: 2.1 time: 0.167453 Sep 01 07:15:18.563767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 74/159] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:18 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:18.676037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:18.676649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:18.685319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:18.687261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:18.687733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:18.688434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:18.688885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:18.689477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:18.851027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:18.852297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:18.861875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:18.862364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:18.863049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:18.864031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:18.864483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:18.865054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:18.883392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:18.893430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4596cb68-6647-415b-b554-73bbdbfd6bb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.221529 Sep 01 07:15:18.894270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 86/160] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:18 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:19.008355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:19.017229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38450bd7-71b1-408d-a0ec-49e42d9dae77 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.170002 Sep 01 07:15:19.017794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 75/161] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:18 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:19.585226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:19.586062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:19.592405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:19.593279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:19.593826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:19.594536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:19.594983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:19.595570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:19.627798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:19.628288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:19.628726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:19.629207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lazy-loading 'fault' on Instance uuid 9104a7a7-e214-4212-b2c8-d7a1d5b35aee {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:19.674515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '561fa6572e0b4b949d1c09ee9e9d5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f0be015ba44cdfa6c64038e16bd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:19.684004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-acc2bbc3-2b0b-401e-b8b9-e8fac8f75c2c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 200 len: 1350 microversion: 2.1 time: 0.102953 Sep 01 07:15:19.684810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 87/162] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:19 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:19.915768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:19.917063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:19.923460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:19.924165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:19.924489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:19.925288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:19.925702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:19.926117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:20.044187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:20.045441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:20.059403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:20.060278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:20.061682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:20.062743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:20.063666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:20.064532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:20.087681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:20.097990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54c9e32d-61d9-4a9a-aa46-64a82b60e5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.186439 Sep 01 07:15:20.098536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 76/163] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:19 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:20.232523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:20.247070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cffbaa00-f09e-4570-86c8-1b6969f7cc97 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.212425 Sep 01 07:15:20.255196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 88/164] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:20 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:20.708460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:20.709339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:20.718584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:20.719274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:20.719955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:20.721415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:20.721983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:20.722417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:20.758544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] HTTP exception thrown: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Request method failure captured: Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee HTTP/1.1 Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFvC-LMmMMqd3BP4lwremOSOaPYlWPFL6tWg8hRWN5r1i0CK9dMA0j2ex1OcQpp9L6ceGQHj-6V4NrNVeAG6x7z4T41cAeJ93KmK7AwvL-l50rzlUSre80fd1hA9xRaqY5qiYfAbGr2iUWXFjQd2D10W3zEgCDJ_WoQml3P_38CNBig Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 78f0be015ba44cdfa6c64038e16bd5cb Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:20.779545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_78f0be015ba44cdfa6c64038e16bd5cb", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 78f0be015ba44cdfa6c64038e16bd5cb Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-DeleteServersTestJSON-556945613-project Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 561fa6572e0b4b949d1c09ee9e9d5e66 Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-DeleteServersTestJSON-556945613-project Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:20.781019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '9104a7a7-e214-4212-b2c8-d7a1d5b35aee'} Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:20.781899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:20.783169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:20.784399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Returning 404 to user: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:20.784399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-776833cc-1129-413c-9357-2623d984d884 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 404 len: 111 microversion: 2.1 time: 0.080020 Sep 01 07:15:20.784399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 77/165] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:20 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:15:20.960331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:20.968359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:20.975686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:20.976411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:20.976857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:20.977811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:20.978318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:20.980149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:21.000272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] HTTP exception thrown: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Request method failure captured: Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee/os-volume_attachments HTTP/1.1 Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFvC-LMmMMqd3BP4lwremOSOaPYlWPFL6tWg8hRWN5r1i0CK9dMA0j2ex1OcQpp9L6ceGQHj-6V4NrNVeAG6x7z4T41cAeJ93KmK7AwvL-l50rzlUSre80fd1hA9xRaqY5qiYfAbGr2iUWXFjQd2D10W3zEgCDJ_WoQml3P_38CNBig Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 78f0be015ba44cdfa6c64038e16bd5cb Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:15:21.005679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_78f0be015ba44cdfa6c64038e16bd5cb", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 78f0be015ba44cdfa6c64038e16bd5cb Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-DeleteServersTestJSON-556945613-project Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 561fa6572e0b4b949d1c09ee9e9d5e66 Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-DeleteServersTestJSON-556945613-project Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:21.009150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'server_id': '9104a7a7-e214-4212-b2c8-d7a1d5b35aee'} Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:21.010422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:21.012509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:21.014195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Returning 404 to user: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:21.014195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b45cd17-e507-415c-8717-a9ec0eacc39a tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052110 Sep 01 07:15:21.014195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 89/166] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:15:20 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:15:21.119034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:21.119641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:21.147502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:21.149259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:21.150298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:21.153358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:21.154068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:21.157392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:21.267920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:21.268527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:21.282871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:21.282871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:21.282871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:21.282871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:21.283662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:21.283662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:21.421049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:21.432514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de7d5a1a-f7c9-4bf6-9d0a-51f816efbffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.317596 Sep 01 07:15:21.433326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 78/167] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:21 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:21.495923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:21.505640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-042bff16-1233-4002-afc2-184fc688fc01 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.241827 Sep 01 07:15:21.506505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 90/168] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:21 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:22.424320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:22.424887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:22.431879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:22.432369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:22.432805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:22.433535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:22.433980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:22.434397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:22.454870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:22.455486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:22.459742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] HTTP exception thrown: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Request method failure captured: Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee HTTP/1.1 Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFvC-LMmMMqd3BP4lwremOSOaPYlWPFL6tWg8hRWN5r1i0CK9dMA0j2ex1OcQpp9L6ceGQHj-6V4NrNVeAG6x7z4T41cAeJ93KmK7AwvL-l50rzlUSre80fd1hA9xRaqY5qiYfAbGr2iUWXFjQd2D10W3zEgCDJ_WoQml3P_38CNBig Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 78f0be015ba44cdfa6c64038e16bd5cb Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:22.461935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_78f0be015ba44cdfa6c64038e16bd5cb", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 78f0be015ba44cdfa6c64038e16bd5cb Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-DeleteServersTestJSON-556945613-project Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 561fa6572e0b4b949d1c09ee9e9d5e66 Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-DeleteServersTestJSON-556945613-project Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.463313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '9104a7a7-e214-4212-b2c8-d7a1d5b35aee'} Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:22.464128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.465367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.467034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Returning 404 to user: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:22.467034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a82abe5c-9714-441b-9d0a-fddf8332be6c tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 404 len: 111 microversion: 2.1 time: 0.044324 Sep 01 07:15:22.467034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 79/169] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:15:22 2022] DELETE /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:15:22.471873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:22.474354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:22.475062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:22.477382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:22.481083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:22.482344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:22.490910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:22.491518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] [instance: 9104a7a7-e214-4212-b2c8-d7a1d5b35aee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:22.505368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:22.507436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:22.508448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:22.509188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:22.509633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:22.510057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:22.533550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] HTTP exception thrown: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Request method failure captured: Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee HTTP/1.1 Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFvC-LMmMMqd3BP4lwremOSOaPYlWPFL6tWg8hRWN5r1i0CK9dMA0j2ex1OcQpp9L6ceGQHj-6V4NrNVeAG6x7z4T41cAeJ93KmK7AwvL-l50rzlUSre80fd1hA9xRaqY5qiYfAbGr2iUWXFjQd2D10W3zEgCDJ_WoQml3P_38CNBig Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 78f0be015ba44cdfa6c64038e16bd5cb Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:22.535073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/78f0be015ba44cdfa6c64038e16bd5cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_78f0be015ba44cdfa6c64038e16bd5cb", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 78f0be015ba44cdfa6c64038e16bd5cb Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-DeleteServersTestJSON-556945613 Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-DeleteServersTestJSON-556945613-project Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 561fa6572e0b4b949d1c09ee9e9d5e66 Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-DeleteServersTestJSON-556945613-project Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.536602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '9104a7a7-e214-4212-b2c8-d7a1d5b35aee'} Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:22.537521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. Sep 01 07:15:22.538957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:22.540716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] Returning 404 to user: Instance 9104a7a7-e214-4212-b2c8-d7a1d5b35aee could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:22.540716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-abc3adee-b798-4cde-83bc-4500c42b0631 tempest-DeleteServersTestJSON-556945613 tempest-DeleteServersTestJSON-556945613-project] 10.222.0.46 "GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee" status: 404 len: 111 microversion: 2.1 time: 0.057625 Sep 01 07:15:22.540716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 80/170] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:22 2022] GET /compute/v2.1/servers/9104a7a7-e214-4212-b2c8-d7a1d5b35aee => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:15:22.545376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:22.546027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:22.552236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:22.552723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:22.553174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:22.553873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:22.554320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:22.555269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:22.813108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:22.826109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-578419b2-6214-4575-9d4c-abc607d075d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.374862 Sep 01 07:15:22.826914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 91/171] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:22 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:22.853284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:22.865569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46881f3f-837b-40ba-97d2-b6c60d58e7f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.323173 Sep 01 07:15:22.867168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 81/172] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:22 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:23.239684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-67206c5b-8c2f-4aa3-8b49-171dfd63349b req-329adf01-cb75-4403-ac6e-db55fd9cb816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13a267d-8f48-4ea0-a8cf-7936cc113c92", "name": "network-vif-plugged", "status": "completed", "tag": "d12164dc-498a-41ed-a3b8-3789c71d40be"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:23.251488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-67206c5b-8c2f-4aa3-8b49-171dfd63349b req-329adf01-cb75-4403-ac6e-db55fd9cb816 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:23.252238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-67206c5b-8c2f-4aa3-8b49-171dfd63349b req-329adf01-cb75-4403-ac6e-db55fd9cb816 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:23.253093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-67206c5b-8c2f-4aa3-8b49-171dfd63349b req-329adf01-cb75-4403-ac6e-db55fd9cb816 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:23.270137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-67206c5b-8c2f-4aa3-8b49-171dfd63349b req-329adf01-cb75-4403-ac6e-db55fd9cb816 service nova] Creating event network-vif-plugged:d12164dc-498a-41ed-a3b8-3789c71d40be for instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 on hv-cinder-73306 Sep 01 07:15:23.276284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-67206c5b-8c2f-4aa3-8b49-171dfd63349b req-329adf01-cb75-4403-ac6e-db55fd9cb816 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040400 Sep 01 07:15:23.277308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 92/173] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:15:23.848018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:23.848721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:23.856906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:23.857611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:23.858473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:23.859256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:23.859936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:23.860360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:23.887272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:23.888236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:23.917271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:23.917931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:23.918489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:23.919971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:23.920990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:23.921536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:24.205163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:24.217526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e078293-f2f3-4814-bd6f-dbe1531364f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.373427 Sep 01 07:15:24.218107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 82/174] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:23 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:24.269158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:24.279679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-259e2fba-f253-46f2-8bd7-d0d78e3bd820 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.397650 Sep 01 07:15:24.280728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 93/175] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:23 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:25.241362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:25.241996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:25.251614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:25.255130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:25.255584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:25.256418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:25.257151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:25.257622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:25.301785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:25.303878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:25.325574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:25.329306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:25.331220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:25.332411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:25.334311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:25.336375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:25.337035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:26.254736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:26.271689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-276afbf8-d50c-42ce-a315-62375074d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1314 microversion: 2.1 time: 0.974470 Sep 01 07:15:26.272290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 94/176] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:25 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:26.272841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:26.289765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b8cf404-c10f-4ead-ae65-bdcf642eecb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 1.052475 Sep 01 07:15:26.290673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 83/177] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:25 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:27.292729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:27.293465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:27.301265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:27.302069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:27.302570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:27.303319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:27.303843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:27.304902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:27.319636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:27.325685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:27.339624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:27.340189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:27.340688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:27.341512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:27.342148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:27.342570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:27.568278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:27.579240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4129459f-e156-49fa-8761-1a73e1c0d97c tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1463 microversion: 2.1 time: 0.290519 Sep 01 07:15:27.580944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 95/178] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:27 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1463 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:27.594486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:27.607214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9fb183e-70d1-41b9-bb41-c29a5001aaf1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.297107 Sep 01 07:15:27.608228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 84/179] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:27 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:27.650152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:27.650781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:27.657315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:27.657937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:27.658230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:27.658973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:27.659364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:27.659836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:27.688162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:15:27.777713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5630bd32-deb0-4d79-a9ce-d8d722264ced tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 204 len: 0 microversion: 2.1 time: 0.131027 Sep 01 07:15:27.778754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 96/180] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:15:27 2022] DELETE /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 07:15:27.789415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:27.790320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:27.799288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:27.800015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:27.800594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:27.801857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:27.802427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:27.802852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:27.994420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:28.003978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28c2b728-dac1-4be0-9cb4-346fc4ee3886 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1469 microversion: 2.1 time: 0.220041 Sep 01 07:15:28.004710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 85/181] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:27 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:28.636251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:28.637014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:28.644663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:28.645185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:28.645629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:28.646327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:28.646863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:28.647492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:28.830768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:28.839597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a2b9a7ba-d772-4337-8320-b1a3e5cb6f6a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.210773 Sep 01 07:15:28.840405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 97/182] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:28 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:28.991122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0ce81dc-1d69-4be0-9ecc-f7f1365a903b tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Action: 'create', calling method: .version_select at 0x7f78cf4dd550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-327298513", "metadata": {"Type": "work"}}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0ce81dc-1d69-4be0-9ecc-f7f1365a903b tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Request method failure captured: Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 121 Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFwQXpzvgYbd9PJykjX33nrSWIt_NFUCBfDRJW6wfVzzVw2ONHBkoSjw0buziFZVLTs9QP_7CYJFkLHJv52IRdyfEzG9qaRqsNY0xH14SvTpapSdh6z0p95zO2P9zMmb0QoWYtc2fE_yRk1R6q9wdfutfva2GJkM7j5TDVmZyqqfzkQ Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:28.998887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_57f426d9b88f4fd98f8c0226209aa018", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: c6f91a084954447f816ca7b789536ef3 Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-327298513", "metadata": {"Type": "work"}}} Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: Sep 01 07:15:29.000472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-327298513', 'metadata': {'Type': 'work'}}}} Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise error Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:29.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 07:15:29.006026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 07:15:29.008013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 07:15:29.008013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.008013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0ce81dc-1d69-4be0-9ecc-f7f1365a903b tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:29.008013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0ce81dc-1d69-4be0-9ecc-f7f1365a903b tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129292 Sep 01 07:15:29.008013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 86/183] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Sep 1 07:15:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:15:29.011997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1cca5b71-7077-4c96-b614-dbb61cfa9c88 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Action: 'create', calling method: .version_select at 0x7f78cf4acb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1815880106", "metadata": {"Type": "work"}}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1cca5b71-7077-4c96-b614-dbb61cfa9c88 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Request method failure captured: Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 120 Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFwQXpzvgYbd9PJykjX33nrSWIt_NFUCBfDRJW6wfVzzVw2ONHBkoSjw0buziFZVLTs9QP_7CYJFkLHJv52IRdyfEzG9qaRqsNY0xH14SvTpapSdh6z0p95zO2P9zMmb0QoWYtc2fE_yRk1R6q9wdfutfva2GJkM7j5TDVmZyqqfzkQ Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:15:29.016674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_57f426d9b88f4fd98f8c0226209aa018", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: c6f91a084954447f816ca7b789536ef3 Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1815880106", "metadata": {"Type": "work"}}} Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: Sep 01 07:15:29.018084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1815880106', 'metadata': {'Type': 'work'}}}} Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise error Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi '0' Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:29.019001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 07:15:29.024749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 07:15:29.026340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 07:15:29.026340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.026340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1cca5b71-7077-4c96-b614-dbb61cfa9c88 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:29.026340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1cca5b71-7077-4c96-b614-dbb61cfa9c88 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010525 Sep 01 07:15:29.026340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 98/184] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Sep 1 07:15:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:15:29.028539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:29.029087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:29.031514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36d1474d-04a2-4a4e-9caf-b03e590bfe9e tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Action: 'create', calling method: .version_select at 0x7f78cf4f3790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-35850983", "metadata": {"Type": "work"}}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:29.036442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36d1474d-04a2-4a4e-9caf-b03e590bfe9e tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Request method failure captured: Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 117 Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFwQXpzvgYbd9PJykjX33nrSWIt_NFUCBfDRJW6wfVzzVw2ONHBkoSjw0buziFZVLTs9QP_7CYJFkLHJv52IRdyfEzG9qaRqsNY0xH14SvTpapSdh6z0p95zO2P9zMmb0QoWYtc2fE_yRk1R6q9wdfutfva2GJkM7j5TDVmZyqqfzkQ Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:29.037005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_57f426d9b88f4fd98f8c0226209aa018", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: c6f91a084954447f816ca7b789536ef3 Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-35850983", "metadata": {"Type": "work"}}} Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: Sep 01 07:15:29.038342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-35850983', 'metadata': {'Type': 'work'}}}} Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise error Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi '' Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:29.039170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 07:15:29.040547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 07:15:29.041775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 07:15:29.041775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.041775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36d1474d-04a2-4a4e-9caf-b03e590bfe9e tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:29.041775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36d1474d-04a2-4a4e-9caf-b03e590bfe9e tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011157 Sep 01 07:15:29.042402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:29.043119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:29.044019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:29.045042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:29.045393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 87/185] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Sep 1 07:15:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:15:29.045763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:29.069218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bed9a2a-32aa-419f-85e9-34b647f9bd2d tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Calling method '.version_select at 0x7f78cf727b80>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:29.103985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-3bed9a2a-32aa-419f-85e9-34b647f9bd2d tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] HTTP exception thrown: Volume tempest-invalid-1006331199 could not be found. Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bed9a2a-32aa-419f-85e9-34b647f9bd2d tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Request method failure captured: Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1006331199 HTTP/1.1 Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFwQXpzvgYbd9PJykjX33nrSWIt_NFUCBfDRJW6wfVzzVw2ONHBkoSjw0buziFZVLTs9QP_7CYJFkLHJv52IRdyfEzG9qaRqsNY0xH14SvTpapSdh6z0p95zO2P9zMmb0QoWYtc2fE_yRk1R6q9wdfutfva2GJkM7j5TDVmZyqqfzkQ Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:29.107895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_57f426d9b88f4fd98f8c0226209aa018", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: c6f91a084954447f816ca7b789536ef3 Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Volume tempest-invalid-1006331199 could not be found. Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'tempest-invalid-1006331199'} Sep 01 07:15:29.109097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1006331199 could not be found. (HTTP 404) (Request-ID: req-09634298-289a-4a51-a65d-3d2312ba4702) Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.109872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 07:15:29.111394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1006331199 could not be found. Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:15:29.112517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1006331199 could not be found. Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1006331199 could not be found. Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bed9a2a-32aa-419f-85e9-34b647f9bd2d tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Returning 404 to user: Volume tempest-invalid-1006331199 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:29.113645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3bed9a2a-32aa-419f-85e9-34b647f9bd2d tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1006331199" status: 404 len: 99 microversion: 2.1 time: 0.062740 Sep 01 07:15:29.114659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 88/186] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Sep 1 07:15:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1006331199 => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 07:15:29.120969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40f02e9c-4ecd-4d8f-8832-35ee266288ed tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005012 Sep 01 07:15:29.121841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 89/187] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Sep 1 07:15:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 07:15:29.130507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28b3eb2a-cd0c-4f05-b820-a332e36a50de tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003846 Sep 01 07:15:29.131015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 90/188] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Sep 1 07:15:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 01 07:15:29.141765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63971466-b387-4e8f-87f8-ad36704fc085 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Calling method '.version_select at 0x7f78cf4dd820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:29.172454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-63971466-b387-4e8f-87f8-ad36704fc085 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] HTTP exception thrown: Volume 50401be4-630f-411c-b8f6-929a4d1028a8 could not be found. Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63971466-b387-4e8f-87f8-ad36704fc085 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Request method failure captured: Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/os-volumes/50401be4-630f-411c-b8f6-929a4d1028a8 HTTP/1.1 Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFwQXpzvgYbd9PJykjX33nrSWIt_NFUCBfDRJW6wfVzzVw2ONHBkoSjw0buziFZVLTs9QP_7CYJFkLHJv52IRdyfEzG9qaRqsNY0xH14SvTpapSdh6z0p95zO2P9zMmb0QoWYtc2fE_yRk1R6q9wdfutfva2GJkM7j5TDVmZyqqfzkQ Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:29.174595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_57f426d9b88f4fd98f8c0226209aa018", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: c6f91a084954447f816ca7b789536ef3 Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Volume 50401be4-630f-411c-b8f6-929a4d1028a8 could not be found. Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '50401be4-630f-411c-b8f6-929a4d1028a8'} Sep 01 07:15:29.175804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50401be4-630f-411c-b8f6-929a4d1028a8 could not be found. (HTTP 404) (Request-ID: req-4b33db1d-6e55-419e-b6a9-f2b4bbe8ac55) Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.176539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 07:15:29.178214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50401be4-630f-411c-b8f6-929a4d1028a8 could not be found. Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 07:15:29.182358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50401be4-630f-411c-b8f6-929a4d1028a8 could not be found. Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50401be4-630f-411c-b8f6-929a4d1028a8 could not be found. Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63971466-b387-4e8f-87f8-ad36704fc085 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Returning 404 to user: Volume 50401be4-630f-411c-b8f6-929a4d1028a8 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63971466-b387-4e8f-87f8-ad36704fc085 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/50401be4-630f-411c-b8f6-929a4d1028a8" status: 404 len: 109 microversion: 2.1 time: 0.038071 Sep 01 07:15:29.184657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 91/189] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:15:29 2022] DELETE /compute/v2.1/os-volumes/50401be4-630f-411c-b8f6-929a4d1028a8 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 07:15:29.193491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb19fe7d-94c2-467c-9240-2ab64b7bfa23 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Calling method '.version_select at 0x7f78cf4ddaf0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:29.265182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-cb19fe7d-94c2-467c-9240-2ab64b7bfa23 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] HTTP exception thrown: Volume bae73f36-66d9-4f2a-a539-292ddaeb937f could not be found. Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb19fe7d-94c2-467c-9240-2ab64b7bfa23 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Request method failure captured: Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/os-volumes/bae73f36-66d9-4f2a-a539-292ddaeb937f HTTP/1.1 Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFwQXpzvgYbd9PJykjX33nrSWIt_NFUCBfDRJW6wfVzzVw2ONHBkoSjw0buziFZVLTs9QP_7CYJFkLHJv52IRdyfEzG9qaRqsNY0xH14SvTpapSdh6z0p95zO2P9zMmb0QoWYtc2fE_yRk1R6q9wdfutfva2GJkM7j5TDVmZyqqfzkQ Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:29.267138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/57f426d9b88f4fd98f8c0226209aa018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_57f426d9b88f4fd98f8c0226209aa018", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 57f426d9b88f4fd98f8c0226209aa018 Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1618512340 Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: c6f91a084954447f816ca7b789536ef3 Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1618512340-project Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Volume bae73f36-66d9-4f2a-a539-292ddaeb937f could not be found. Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'bae73f36-66d9-4f2a-a539-292ddaeb937f'} Sep 01 07:15:29.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bae73f36-66d9-4f2a-a539-292ddaeb937f could not be found. (HTTP 404) (Request-ID: req-9a5fb8f4-9872-4be3-bc2f-43a0ed14867c) Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.269165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 07:15:29.272464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bae73f36-66d9-4f2a-a539-292ddaeb937f could not be found. Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 07:15:29.273790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bae73f36-66d9-4f2a-a539-292ddaeb937f could not be found. Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bae73f36-66d9-4f2a-a539-292ddaeb937f could not be found. Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb19fe7d-94c2-467c-9240-2ab64b7bfa23 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] Returning 404 to user: Volume bae73f36-66d9-4f2a-a539-292ddaeb937f could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb19fe7d-94c2-467c-9240-2ab64b7bfa23 tempest-VolumesNegativeTest-1618512340 tempest-VolumesNegativeTest-1618512340-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/bae73f36-66d9-4f2a-a539-292ddaeb937f" status: 404 len: 109 microversion: 2.1 time: 0.085483 Sep 01 07:15:29.274942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 92/190] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 07:15:29 2022] GET /compute/v2.1/os-volumes/bae73f36-66d9-4f2a-a539-292ddaeb937f => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:15:29.280153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:29.289480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-107f7ca4-8250-4e60-bbee-3ec6f2576c7e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1469 microversion: 2.1 time: 0.264462 Sep 01 07:15:29.290872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 99/191] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:29 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:29.862927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:29.863549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:29.871679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:29.872258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:29.872823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:29.874062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:29.874686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:29.875350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:30.210023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:30.227800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb954f34-a4b3-4d3a-993b-5140b06727db tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.369220 Sep 01 07:15:30.228418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 93/192] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:29 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:30.325010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:30.328339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:30.350002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:30.350734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:30.353702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:30.354693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:30.355177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:30.355773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:30.605956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:30.609640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:30.614875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-359721f4-6085-42bc-af8c-07d74eeb1edd tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1469 microversion: 2.1 time: 0.306883 Sep 01 07:15:30.615714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 100/193] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:30 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1469 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:30.784155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-3ff080b5-50b7-4f15-a9bc-eb083b887879 req-a3ad3552-6a51-4937-a35e-2ceea8f4e656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13a267d-8f48-4ea0-a8cf-7936cc113c92", "name": "network-vif-deleted", "tag": "d12164dc-498a-41ed-a3b8-3789c71d40be"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:30.795738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3ff080b5-50b7-4f15-a9bc-eb083b887879 req-a3ad3552-6a51-4937-a35e-2ceea8f4e656 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:30.796443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3ff080b5-50b7-4f15-a9bc-eb083b887879 req-a3ad3552-6a51-4937-a35e-2ceea8f4e656 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:30.797035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3ff080b5-50b7-4f15-a9bc-eb083b887879 req-a3ad3552-6a51-4937-a35e-2ceea8f4e656 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:30.822834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-3ff080b5-50b7-4f15-a9bc-eb083b887879 req-a3ad3552-6a51-4937-a35e-2ceea8f4e656 service nova] Creating event network-vif-deleted:d12164dc-498a-41ed-a3b8-3789c71d40be for instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 on hv-cinder-73306 Sep 01 07:15:30.828641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-3ff080b5-50b7-4f15-a9bc-eb083b887879 req-a3ad3552-6a51-4937-a35e-2ceea8f4e656 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048326 Sep 01 07:15:30.829262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 94/194] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:15:31.248172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:31.248976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:31.256606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:31.257616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:31.258151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:31.259008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:31.259496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:31.259916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:31.452410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:31.461411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e694b4c1-5036-4007-aa4b-eb0d6db7b0f2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.217022 Sep 01 07:15:31.462026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 101/195] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:31 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:31.500631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1351920452", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "networks": [{"uuid": "a3bab48a-bca2-4bf8-b9ee-cd7fcd899a2d"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:31.561785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] validate_networks() for [('a3bab48a-bca2-4bf8-b9ee-cd7fcd899a2d', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:15:31.635848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:31.636466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:31.642567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:31.647483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:31.648651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:31.654497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:31.655232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:31.656349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:31.768012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:31.780054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-39047c4e-0ff1-4671-8965-5c5d53f2c478 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1427 microversion: 2.1 time: 0.148670 Sep 01 07:15:31.780653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 102/196] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:31 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:32.017514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:15:32.018000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:15:32.018641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:15:32.019007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:15:32.019489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:15:32.021874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:32.036264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:32.038951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:32.039579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:32.040819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:32.041639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:32.042226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:32.061199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Getting quotas for project 7d030bb54a7c4e489734b7c86b40b464. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:15:32.065160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Getting quotas for user 1cc519da0b5d40268b29bb1bef89049b and project 7d030bb54a7c4e489734b7c86b40b464. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:15:32.077301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:15:32.080004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:15:32.130172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9331dcb6-7896-41f3-a35c-11d2225ce49f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633242 Sep 01 07:15:32.131072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 95/197] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:15:32.142862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3531ddfc-5d05-4539-8c0a-db53383a73a3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:32.143469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3531ddfc-5d05-4539-8c0a-db53383a73a3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:32.240594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3531ddfc-5d05-4539-8c0a-db53383a73a3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:32.249273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3531ddfc-5d05-4539-8c0a-db53383a73a3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1214 microversion: 2.1 time: 0.110132 Sep 01 07:15:32.258097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 103/198] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:32 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:32.485970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:32.486840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:32.495474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:32.496061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:32.496591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:32.497400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:32.498069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:32.499485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:32.691999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:32.699824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c07cab6e-ab36-486a-b89d-a8b79089cfe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.218866 Sep 01 07:15:32.700386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 96/199] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:32 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:32.801404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:32.802025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:32.809076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:32.809692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:32.810239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:32.810972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:32.811456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:32.812012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:32.874135 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:32.882290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c625966-6afe-413e-8b7d-104007876d7d tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1427 microversion: 2.1 time: 0.084440 Sep 01 07:15:32.882939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 104/200] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:32 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:33.278615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:33.279207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:33.285613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:33.286089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:33.286518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:33.287197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:33.287644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:33.288059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:33.352056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:33.359911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e721c633-2e31-4fdc-ace6-da4fdd687e6c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1218 microversion: 2.1 time: 0.085455 Sep 01 07:15:33.360693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 97/201] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:33 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:33.719577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:33.720187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:33.725991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:33.726474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:33.726904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:33.727590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:33.728036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:33.728456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:33.872889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:33.880591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e791b791-7145-4e5d-acda-7f8b8a56c041 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.164764 Sep 01 07:15:33.881246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 105/202] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:33 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:33.903352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:33.903954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:33.909880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:33.910359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:33.910867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:33.911464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:33.911912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:33.912331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:33.974044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:33.981880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e509c29-b4c8-4676-82de-19d8da336966 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1427 microversion: 2.1 time: 0.082580 Sep 01 07:15:33.982437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 98/203] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:33 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:34.382331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:34.383239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:34.389438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:34.389931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:34.390372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:34.391136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:34.391762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:34.392189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:34.455062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:34.463397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2e013843-359a-4f68-94cc-c92d7f3e321f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1218 microversion: 2.1 time: 0.086486 Sep 01 07:15:34.464188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 106/204] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:34 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:34.906862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:34.907578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:34.913836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:34.914322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:34.914757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:34.915447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:34.916110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:34.916806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:35.004528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:35.005197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:35.017540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:35.019810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:35.020597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:35.022904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:35.023381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:35.025058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:35.119587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:35.120101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:35.120541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:35.120995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lazy-loading 'fault' on Instance uuid d13a267d-8f48-4ea0-a8cf-7936cc113c92 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:35.130787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:35.140079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5fd7b38d-fe54-4d70-89bf-a22a8bd6534c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.238527 Sep 01 07:15:35.140722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 99/205] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:34 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:35.164472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:35.172656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-835c36c8-9c92-4c0e-9524-074a26a961aa tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1304 microversion: 2.1 time: 0.172256 Sep 01 07:15:35.173255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 107/206] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:34 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:35.483910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:35.484638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:35.492420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:35.493534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:35.493966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:35.494819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:35.495203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:35.495619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:35.555033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:35.563165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3cc9a9f4-4338-4e2a-832a-7edbadb498cb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1266 microversion: 2.1 time: 0.083321 Sep 01 07:15:35.563808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 100/207] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:35 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:36.162674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:36.163305 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:36.169895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:36.170380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:36.170812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:36.171507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:36.171958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:36.172381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:36.193522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:36.194334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:36.200124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:36.200603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:36.201032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:36.201744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:36.202196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:36.202950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:36.237696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:36.238087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:36.238513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:36.238960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lazy-loading 'fault' on Instance uuid d13a267d-8f48-4ea0-a8cf-7936cc113c92 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:36.292778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:36.304066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-388aff8c-c524-419a-b4e2-0d0edec47d4e tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1304 microversion: 2.1 time: 0.114198 Sep 01 07:15:36.305340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 101/208] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:36 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:36.342737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:36.351213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbdb04eb-2842-4cd8-9bd9-577ea3e983e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.192283 Sep 01 07:15:36.351778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 108/209] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:36 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:36.584458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:36.585060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:36.591649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:36.592125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:36.592558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:36.593289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:36.593727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:36.594142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:36.655437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:36.662911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4231eaa-737e-4212-abce-544b97c118fa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1266 microversion: 2.1 time: 0.082337 Sep 01 07:15:36.663505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 102/210] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:36 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:37.324645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:37.325298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:37.327587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:37.332998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:37.333628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:37.334076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:37.334953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:37.335415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:37.335846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:37.377910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:37.379001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:37.403218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:37.404113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:37.404806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:37.405844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:37.408109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:37.408890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:37.524523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:37.525012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:37.525478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:37.525926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lazy-loading 'fault' on Instance uuid d13a267d-8f48-4ea0-a8cf-7936cc113c92 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:37.584231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:37.592333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28884030-e532-404f-9fe6-343e1badc765 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1304 microversion: 2.1 time: 0.271867 Sep 01 07:15:37.593040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 109/211] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:37 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1304 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:37.679115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:37.683485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:37.684312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:37.686936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a755590a-d5c0-441e-8850-7fb2a7092bc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.314621 Sep 01 07:15:37.687499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 103/212] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:37 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:37.690966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:37.691462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:37.691901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:37.692603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:37.693248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:37.693704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:37.765953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:37.773619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8133e567-8a7d-4d8b-b49d-bef7312c5481 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1266 microversion: 2.1 time: 0.094033 Sep 01 07:15:37.775104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 110/213] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:37 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:38.613292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:38.614007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:38.620751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:38.621265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:38.621720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:38.622403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:38.622852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:38.623271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:38.668792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:38.669242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:38.669716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:38.670113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lazy-loading 'fault' on Instance uuid d13a267d-8f48-4ea0-a8cf-7936cc113c92 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:38.707574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:38.709349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:38.710258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:38.716289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:38.716780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:38.717480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:38.717957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de90f34b-7856-4361-b405-a9e050b93920 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1304 microversion: 2.1 time: 0.108469 Sep 01 07:15:38.718183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:38.718640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:38.719124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:38.731730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 104/214] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:38 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:38.802063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:38.802880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:38.809691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:38.810164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:38.810592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:38.811281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:38.812334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:38.813173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:38.892398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:38.896789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:38.900102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5cbee61f-ef67-4a74-8973-8a763a1098a9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1266 microversion: 2.1 time: 0.105592 Sep 01 07:15:38.900831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 105/215] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:38 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:38.906556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fcc4f79b-13b5-4239-a001-756e532cc8fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.202781 Sep 01 07:15:38.917728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 111/216] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:38 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:39.738625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:39.739223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:39.745684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:39.746161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:39.746590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:39.747267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:39.747711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:39.748128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:39.779090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:39.779568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:39.779999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:39.780436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lazy-loading 'fault' on Instance uuid d13a267d-8f48-4ea0-a8cf-7936cc113c92 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:39.818787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:39.826729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f653c4b6-0a6d-497b-a8d1-233dd81432fc tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1304 microversion: 2.1 time: 0.091875 Sep 01 07:15:39.827289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 106/217] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:39 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:39.920450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:39.921052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:39.927719 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:39.928330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:39.932031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:39.932542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:39.933008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:39.933750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:39.935435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:39.936205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:39.937108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:39.937609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:39.938032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:39.938716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:39.939163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:39.939585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:39.958161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:40.011651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:40.019331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e6790e2-8056-4de0-816c-ff2f57bc00e6 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1266 microversion: 2.1 time: 0.102705 Sep 01 07:15:40.019886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 112/218] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:39 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:40.100721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:40.108804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1e9ecff-0e04-4093-bb09-02c1c66f1916 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.185034 Sep 01 07:15:40.109409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 107/219] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:39 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:40.847338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:40.847894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:40.854479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:40.854967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:40.855408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:40.856103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:40.856557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:40.856984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:40.890970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:40.891455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:40.891895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:40.892340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lazy-loading 'fault' on Instance uuid d13a267d-8f48-4ea0-a8cf-7936cc113c92 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:40.930796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83123e2a0aaa4f17b2f3c7dd70572658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9f3629cb0e4cf393ddf8942c5a6946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:40.938281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2727237-b0f4-4a38-8b7b-b0d5c8a0e2f2 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 200 len: 1304 microversion: 2.1 time: 0.094837 Sep 01 07:15:40.938834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 113/220] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:40 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:41.039628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:41.040137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:41.046038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:41.046512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:41.046942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:41.047619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:41.048069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:41.048479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:41.107937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:41.115398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07dff72f-df2f-4fae-9b0a-b0973e69726b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1266 microversion: 2.1 time: 0.079635 Sep 01 07:15:41.115951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 108/221] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:41 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:41.129937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:41.130539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:41.137064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:41.137591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:41.138003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:41.138684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:41.139137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:41.139556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:41.271950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:41.279512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aff02233-a483-484f-aa0c-1b3345ced24a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1520 microversion: 2.1 time: 0.153351 Sep 01 07:15:41.280072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 114/222] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:41 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:41.958408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:41.958916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] [instance: d13a267d-8f48-4ea0-a8cf-7936cc113c92] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:41.966744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:41.967232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:41.967640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:41.969242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:41.969736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:41.970494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:41.986710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] HTTP exception thrown: Instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 could not be found. Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Request method failure captured: Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 HTTP/1.1 Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFv1nHCON4p7czeD3u3KcDy1hd_8OO4rpogvj5A9QTVLyKjoFd7QWMvQHrFhx_rOrXcZOFqhznLEeJDqC-Ke7rjZ5Edfx13wprOu3QfrDJm4NdSIKYUW3BaWyaKAaHaU-dYmMI-pkLyKlc8a0u-5li3-OvE_-h6Ja3TtDukXUPaKMUg Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 8e9f3629cb0e4cf393ddf8942c5a6946 Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-1214207343 Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:15:41.988306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8e9f3629cb0e4cf393ddf8942c5a6946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8e9f3629cb0e4cf393ddf8942c5a6946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8e9f3629cb0e4cf393ddf8942c5a6946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8e9f3629cb0e4cf393ddf8942c5a6946", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-1214207343 Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 8e9f3629cb0e4cf393ddf8942c5a6946 Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-1214207343 Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-1214207343-project Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 83123e2a0aaa4f17b2f3c7dd70572658 Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-1214207343-project Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 could not be found. Sep 01 07:15:41.989839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'd13a267d-8f48-4ea0-a8cf-7936cc113c92'} Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 could not be found. Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:15:41.990679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 could not be found. Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 could not be found. Sep 01 07:15:41.992077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:15:41.993508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] Returning 404 to user: Instance d13a267d-8f48-4ea0-a8cf-7936cc113c92 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:15:41.993508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18f22895-32c3-47d1-8e0d-95c7ab33b3e6 tempest-VolumesNegativeTest-1214207343 tempest-VolumesNegativeTest-1214207343-project] 10.222.0.46 "GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92" status: 404 len: 111 microversion: 2.1 time: 0.035232 Sep 01 07:15:41.993508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 109/223] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:41 2022] GET /compute/v2.1/servers/d13a267d-8f48-4ea0-a8cf-7936cc113c92 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:15:42.136536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:42.137457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:42.147059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:42.155581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:42.156133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:42.157081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:42.157716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:42.158219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:42.236635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:42.244280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ce09639-0d15-4ff7-bd98-7ab3cf95d40f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1284 microversion: 2.1 time: 0.112436 Sep 01 07:15:42.244911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 115/224] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:42 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:42.300373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:42.301282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:42.309278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:42.310208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:42.312103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:42.312923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:42.313533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:42.314353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:42.314933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:42.315559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:42.500311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:42.510753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cdf777f8-36ef-477c-9434-d24fc2c55537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1500 microversion: 2.1 time: 0.214785 Sep 01 07:15:42.526287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 110/225] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:42 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:42.531882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:42.532494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:42.534356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:42.540334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:42.540831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:42.541304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:42.542013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:42.542475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:42.542899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:42.747299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:42.756628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ddf96a61-93fa-48c3-ac52-fd51686e2958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1516 microversion: 2.1 time: 0.228531 Sep 01 07:15:42.758049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 116/226] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:42 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:43.264921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:43.265554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:43.271490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:43.272030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:43.272541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:43.273318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:43.273860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:43.274336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:43.406401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:43.415534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-537cb225-dc19-48ae-b66f-5db728ef43d4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.153612 Sep 01 07:15:43.416186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 111/227] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:43 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:44.436570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:44.437195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:44.444078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:44.444911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:44.445382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:44.446735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:44.447187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:44.447612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:44.466890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:15:44.585682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:44.597162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df765301-4df8-4d87-874f-59cfe790be00 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.164626 Sep 01 07:15:44.597723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 117/228] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:44 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:45.343275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-e8e6b36b-37fb-4246-bb99-a796f5364057 req-d62327a9-1276-4011-b7c4-9944a67746d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed61ceb-422b-4de0-8284-7ba5c2e55f5b", "tag": "cb9db1f9-a799-4eab-a6f2-b4257bfd3d2e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:45.353309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e8e6b36b-37fb-4246-bb99-a796f5364057 req-d62327a9-1276-4011-b7c4-9944a67746d8 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:45.353809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e8e6b36b-37fb-4246-bb99-a796f5364057 req-d62327a9-1276-4011-b7c4-9944a67746d8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:45.354343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e8e6b36b-37fb-4246-bb99-a796f5364057 req-d62327a9-1276-4011-b7c4-9944a67746d8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:45.365210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-e8e6b36b-37fb-4246-bb99-a796f5364057 req-d62327a9-1276-4011-b7c4-9944a67746d8 service nova] Creating event network-changed:cb9db1f9-a799-4eab-a6f2-b4257bfd3d2e for instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b on hv-cinder-73306 Sep 01 07:15:45.370514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-e8e6b36b-37fb-4246-bb99-a796f5364057 req-d62327a9-1276-4011-b7c4-9944a67746d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030905 Sep 01 07:15:45.371196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 112/229] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:15:45.618192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:45.618841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:45.625186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:45.625678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:45.626116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:45.626805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:45.627259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:45.627685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:45.751344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:45.762409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-88ef6ce5-cbda-4ba6-af7d-435941e87d9b tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.148115 Sep 01 07:15:45.763364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 118/230] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:45 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:46.783318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:46.784082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:46.802690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:46.803285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:46.803665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:46.804350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:46.804799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:46.805375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:46.953861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:46.962684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ed78697-58f8-4050-9a6d-1a2123d1c74c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.183502 Sep 01 07:15:46.963261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 113/231] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:46 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:47.361216 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:47.363559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:47.371016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:47.371507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:47.371990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:47.372806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:47.373299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:47.373723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:47.398198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lazy-loading 'flavor' on Instance uuid 807e6a8a-bf4f-4892-b8e8-4039c7e96411 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:15:47.474407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-144122a8-5318-43d1-bef3-31fbef4d56ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411/action" status: 200 len: 32 microversion: 2.1 time: 0.117181 Sep 01 07:15:47.474999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 119/232] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:15:47 2022] POST /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:15:47.485533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:47.486375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:47.493399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:47.494075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:47.494796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:47.495397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:47.495848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:47.496265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:47.629375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:47.637220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12c974a2-6845-4778-b6fe-88b3c6c9b69b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.155811 Sep 01 07:15:47.637781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 114/233] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:47 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:47.984405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:47.985020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:47.991294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:47.991788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:47.992231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:47.993023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:47.993595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:47.994010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:48.162122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:48.170847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68cc5bf4-7757-436d-8302-8029aff54564 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.191094 Sep 01 07:15:48.171503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 120/234] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:47 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:48.657381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:48.658054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:48.663916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:48.664431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:48.664854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:48.665560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:48.666180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:48.666393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:48.796188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:48.805668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75568d89-c4b7-471e-802c-8c67aacede39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.151367 Sep 01 07:15:48.806257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 115/235] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:48 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:49.191229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:49.191875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:49.198816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:49.199292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:49.199718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:49.200405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:49.200850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:49.201305 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:49.339792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:49.347422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08ae95e9-9882-4dcc-86b3-949f55443867 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.159945 Sep 01 07:15:49.347996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 121/236] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:49 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:49.828768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:49.829523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:49.836838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:49.837347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:49.837774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:49.838459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:49.838943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:49.839522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:50.016559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:50.043033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9634467-5e3e-4a66-ae80-3fc04fe1a5ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.218306 Sep 01 07:15:50.043633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 116/237] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:49 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:50.369502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:50.370077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:50.376554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:50.377515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:50.377870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:50.378806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:50.379421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:50.379870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:50.655681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:50.667037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55acad49-a376-4d95-90c5-b452b80b15a7 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.302305 Sep 01 07:15:50.668121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 122/238] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:50 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:51.062834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:51.067144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:51.073096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:51.073679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:51.074144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:51.074840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:51.075285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:51.075698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:51.552350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:51.565064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-87295805-99e1-4638-8a5b-1b37afd9dead tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.505837 Sep 01 07:15:51.566523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 117/239] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:51 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:51.693528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:51.694142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:51.717673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:51.718159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:51.721142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:51.722083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:51.722707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:51.723290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:52.053757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:52.069126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b1504696-0a87-48b9-ba65-d9cb29e843ed tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.384640 Sep 01 07:15:52.071951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 123/240] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:51 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:52.587737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:52.588470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:52.610647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:52.611137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:52.611569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:52.612273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:52.616067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:52.616674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:52.919907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-010df47a-ae7b-4fea-a81c-a16d5379b4d7 req-4ef03424-80ea-45dc-8939-f9847b47c663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed61ceb-422b-4de0-8284-7ba5c2e55f5b", "name": "network-vif-plugged", "status": "completed", "tag": "cb9db1f9-a799-4eab-a6f2-b4257bfd3d2e"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:15:52.938308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-010df47a-ae7b-4fea-a81c-a16d5379b4d7 req-4ef03424-80ea-45dc-8939-f9847b47c663 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:52.939181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-010df47a-ae7b-4fea-a81c-a16d5379b4d7 req-4ef03424-80ea-45dc-8939-f9847b47c663 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:52.939867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-010df47a-ae7b-4fea-a81c-a16d5379b4d7 req-4ef03424-80ea-45dc-8939-f9847b47c663 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:52.955947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-010df47a-ae7b-4fea-a81c-a16d5379b4d7 req-4ef03424-80ea-45dc-8939-f9847b47c663 service nova] Creating event network-vif-plugged:cb9db1f9-a799-4eab-a6f2-b4257bfd3d2e for instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b on hv-cinder-73306 Sep 01 07:15:52.962550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-010df47a-ae7b-4fea-a81c-a16d5379b4d7 req-4ef03424-80ea-45dc-8939-f9847b47c663 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048904 Sep 01 07:15:52.963947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 124/241] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:15:53.074316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:53.096689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:53.096932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22451ed0-9da3-48bc-8849-0787dc7718da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.513669 Sep 01 07:15:53.097747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 118/242] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:52 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:53.098208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:53.108042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:53.108717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:53.110011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:53.110954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:53.112072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:53.112654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:53.406244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:53.421631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fa086304-4f68-4088-951e-45b53dc7e4e4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.331258 Sep 01 07:15:53.423091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 125/243] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:53 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:54.122508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:54.123790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:54.138662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:54.140368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:54.141363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:54.145314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:54.145921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:54.146516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:54.427172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:54.442577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b744770a-3c97-4a72-a934-23314807fc52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.323908 Sep 01 07:15:54.443656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 119/244] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:54 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:54.447287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:54.448077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:54.461458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:54.461972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:54.463665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:54.465673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:54.466641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:54.467592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:54.692098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:54.704343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85dd0695-2c7e-4546-8b0a-e8b1ae9ff677 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.263565 Sep 01 07:15:54.712115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 126/245] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:54 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:55.471006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:55.472736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:55.482026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:55.482734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:55.483610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:55.485227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:55.486086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:55.486994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:55.664109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:55.672543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7f58223e-3f09-4250-a5c2-83756971f9e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.212359 Sep 01 07:15:55.673105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 120/246] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:55 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:55.731594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:55.732229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:55.740050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:55.740726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:55.741421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:55.742168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:55.743219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:55.745141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:55.945004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:55.954358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-88095c7d-cdaa-4b89-894f-6fdc5e5de9e8 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.230837 Sep 01 07:15:55.955049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 127/247] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:55 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:56.694639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:56.696517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:56.703373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:56.707385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:56.708043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:56.710831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:56.712047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:56.714275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:56.905944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:56.914213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76394e40-62fb-42d2-8ddb-d57b9763137b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.223461 Sep 01 07:15:56.914798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 121/248] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:56 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:15:56.976075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:56.977621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:56.988531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:56.989056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:56.989544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:56.997141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:56.997895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:56.998932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:57.244583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:57.257405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-284d865a-0004-467d-8a6e-048a56daeb52 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1314 microversion: 2.1 time: 0.284778 Sep 01 07:15:57.270813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 128/249] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:56 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:57.937812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:57.940423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:57.949641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:57.950371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:57.951025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:57.951934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:57.952767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:57.953773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:58.156355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:58.164835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-72079b70-76da-4461-b7ab-bce4727af173 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.233169 Sep 01 07:15:58.173255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 122/250] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:57 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:58.284137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:58.285391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:58.297088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:58.297626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:58.298070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:58.298785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:58.299233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:58.300724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:58.618946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:58.627857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-989594a9-f658-40f5-bc77-f1eebdc4010f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1497 microversion: 2.1 time: 0.350798 Sep 01 07:15:58.630016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 129/251] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:58 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1497 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:15:59.190097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:15:59.191286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:15:59.202821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:59.203318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:59.205658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:59.206592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:15:59.213632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:15:59.214082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:15:59.497344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:15:59.506517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a64fdc48-9bf6-4008-b65b-f7f66037fb08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.318849 Sep 01 07:15:59.507381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 123/252] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:15:59 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:00.528234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:00.529153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:00.547584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:00.549559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:00.559379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:00.569757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:00.573043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:00.573782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:00.935152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:00.947653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-21249931-6e38-4a1f-b759-b8b62e01c5d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.423713 Sep 01 07:16:00.961378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 130/253] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:00 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:01.341237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:01.342419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:01.365726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:01.365726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:01.365726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:01.368961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:01.374924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:01.375456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:01.409775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:16:01.481605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:01.580137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d98edf4d-ed46-4f8c-b1d4-1bde98fae5aa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 204 len: 0 microversion: 2.1 time: 0.243273 Sep 01 07:16:01.580717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 124/254] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:16:01 2022] DELETE /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 07:16:01.592054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:01.593857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:01.603900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:01.604945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:01.606367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:01.607568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:01.608263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:01.608938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:01.971097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:01.971807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:01.982843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:01.988849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:01.990075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:01.990972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:01.991506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:01.994262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:02.474712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:02.486573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a46e65c0-b201-4228-ab70-6a83e65f4748 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.520912 Sep 01 07:16:02.488620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 125/255] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:01 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:02.531736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:02.543960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da59d574-9898-4d3c-9a1e-38eb0bd73773 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1503 microversion: 2.1 time: 0.957919 Sep 01 07:16:02.565422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 131/256] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:01 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1503 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:03.521292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:03.522679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:03.528918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:03.554310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:03.556691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:03.557434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:03.558426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:03.559113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:03.559711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:03.585321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:03.586842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:03.597730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:03.598274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:03.599231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:03.600373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:03.600845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:03.601502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:03.827482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:03.838712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd468991-713f-4738-bea1-4d85f0068311 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.328400 Sep 01 07:16:03.839870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 126/257] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:03 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:03.924607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:03.929004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:03.939071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d779c1eb-d282-4e8b-9093-43b9c0ab3316 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1503 microversion: 2.1 time: 0.358875 Sep 01 07:16:03.940086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 132/258] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:03 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:04.861544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:04.862771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:04.872611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:04.877592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:04.879725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:04.881009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:04.890981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:04.892628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:04.960417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:04.961621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:04.980424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:04.980930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:04.981562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:04.982284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:04.984096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:04.984725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:05.141177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:05.152673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8bfc7269-0323-4c78-bf7c-8b56b4c26bf4 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1461 microversion: 2.1 time: 0.196709 Sep 01 07:16:05.154710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 133/259] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:04 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1461 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:05.168016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-d3b82b5e-a874-4d2a-aac0-119c167e1f85 req-bfb58d40-376a-4eda-b7f7-737d95973642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed61ceb-422b-4de0-8284-7ba5c2e55f5b", "name": "network-vif-deleted", "tag": "cb9db1f9-a799-4eab-a6f2-b4257bfd3d2e"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:05.196186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d3b82b5e-a874-4d2a-aac0-119c167e1f85 req-bfb58d40-376a-4eda-b7f7-737d95973642 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:05.197045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d3b82b5e-a874-4d2a-aac0-119c167e1f85 req-bfb58d40-376a-4eda-b7f7-737d95973642 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:05.197702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-d3b82b5e-a874-4d2a-aac0-119c167e1f85 req-bfb58d40-376a-4eda-b7f7-737d95973642 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:05.216552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-d3b82b5e-a874-4d2a-aac0-119c167e1f85 req-bfb58d40-376a-4eda-b7f7-737d95973642 service nova] Creating event network-vif-deleted:cb9db1f9-a799-4eab-a6f2-b4257bfd3d2e for instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b on hv-cinder-73306 Sep 01 07:16:05.222790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-d3b82b5e-a874-4d2a-aac0-119c167e1f85 req-bfb58d40-376a-4eda-b7f7-737d95973642 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064610 Sep 01 07:16:05.223623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 134/260] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:05.266586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:05.275718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d782c2c1-3c61-47a9-9b74-f5bd7d66ea43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.419006 Sep 01 07:16:05.277174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 127/261] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:04 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:06.181265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:06.182300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:06.192702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:06.193426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:06.194144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:06.195330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:06.195972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:06.196685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:06.289630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:06.298491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:06.302472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:06.309421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffe6644e-3aea-4da2-a3a7-afef88d5161a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1461 microversion: 2.1 time: 0.133569 Sep 01 07:16:06.310443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 135/262] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:06 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1461 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:06.322732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:06.330603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:06.331471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:06.332470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:06.333073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:06.333745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:06.498456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:06.510729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9bed447c-d113-4d52-af73-e8c889df62c4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.217318 Sep 01 07:16:06.511726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 128/263] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:06 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:07.344068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:07.346398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:07.360465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=58 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:07.371489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:07.374277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:07.374809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:07.375488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:07.376237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:07.376390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:07.454304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:07.456222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:07.456796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:07.458012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lazy-loading 'fault' on Instance uuid 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:16:07.534297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:07.536958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:07.537663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:07.546881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d0aff1b7-cd4e-4a43-b21d-6c55d1b32ddb tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1304 microversion: 2.1 time: 0.212335 Sep 01 07:16:07.549258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 136/264] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:07 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:07.556365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:07.557667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:07.558295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:07.559571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:07.561476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:07.562511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:07.703691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:07.704693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:07.717833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:07.718482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:07.719099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:07.720299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:07.721157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:07.721888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:07.820668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:07.830220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c3c848b-6fdc-43f5-a40e-7a702ce3d218 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.301514 Sep 01 07:16:07.841696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7292536e-abfc-4698-99c3-934ed072d944 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/ips" status: 200 len: 152 microversion: 2.20 time: 0.139045 Sep 01 07:16:07.841696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 137/265] 10.222.0.46 () {60 vars in 1289 bytes} [Thu Sep 1 07:16:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/ips => generated 152 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:16:07.841967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 129/266] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:07 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:08.572341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:08.572970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:08.587506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:08.587857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:08.588312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:08.588993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:08.600846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:08.601144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:08.647532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:08.648198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:08.649545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:08.650290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lazy-loading 'fault' on Instance uuid 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:16:08.741655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:08.750478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6fafda87-f94d-4cc5-8529-d7ce58ae60ad tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 200 len: 1304 microversion: 2.1 time: 0.182842 Sep 01 07:16:08.751056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 138/267] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:08 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:08.853412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:08.854023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:08.863454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:08.863933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:08.864362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:08.865055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:08.865550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:08.865958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.038974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:09.048301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-404ddd5a-4a5a-4600-b411-d73f8ebfc3e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1502 microversion: 2.1 time: 0.197766 Sep 01 07:16:09.049023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 130/268] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:08 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:09.071745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6668666b-9a37-4e09-889e-8899e36ce64f"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:09.074893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:09.098129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:09.104463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:09.106622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.107594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:09.108062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:09.109634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.161702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] HTTP exception thrown: Cannot 'attach_volume' instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 while it is in vm_state rescued Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Request method failure captured: Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: POST /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411/os-volume_attachments HTTP/1.1 Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 74 Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFvBFFWc6puLNPHy3F-IcgMhvUjqlMzltcrwUBajcvx1etWIhC2rrASYnuJiwBRHYoyD8sjqxApn2ay4Bz_snjhqHekqKNrQ35gssMqLakA1LiYaJ3o8-OnTjJW691ti3PrLANcHhrdA-DRzucAEK5xlDZeeZg7KGvIYpVA9rhtoR5Q Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: c1705474b7954cf1926e9beb2d548587 Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:16:09.166918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1705474b7954cf1926e9beb2d548587", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: c1705474b7954cf1926e9beb2d548587 Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-ServerRescueNegativeTestJSON-547052379-project Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: db4f0928502a43b490de01afc587a846 Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547052379-project Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {"volumeAttachment": {"volumeId": "6668666b-9a37-4e09-889e-8899e36ce64f"}} Sep 01 07:16:09.168824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Cannot 'attach_volume' instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 while it is in vm_state rescued Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'server_id': '807e6a8a-bf4f-4892-b8e8-4039c7e96411', 'body': {'volumeAttachment': {'volumeId': '6668666b-9a37-4e09-889e-8899e36ce64f'}}} Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:16:09.169744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 while it is in vm_state rescued Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:16:09.171094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:16:09.172447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:16:09.172447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:16:09.172447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 while it is in vm_state rescued Sep 01 07:16:09.172447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.174337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Returning 409 to user: Cannot 'attach_volume' instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 while it is in vm_state rescued {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:16:09.176518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3af2625b-9003-44fb-81f5-b67f4859d35d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.110652 Sep 01 07:16:09.177323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 139/269] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:16:09 2022] POST /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411/os-volume_attachments => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 07:16:09.190529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:09.191059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:09.199749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:09.200236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:09.200665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.201386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:09.202006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:09.202588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.316220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-854ecb65-6f1e-4127-aa51-8c430ba1fed1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411/action" status: 202 len: 0 microversion: 2.1 time: 0.130805 Sep 01 07:16:09.317937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 131/270] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:16:09 2022] POST /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:16:09.326145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:09.327005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:09.335840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:09.337170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:09.337824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.338839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:09.339575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:09.340152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.623325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:09.635336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed56e012-4011-4028-b78e-bdd14e4254fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1510 microversion: 2.1 time: 0.313037 Sep 01 07:16:09.637239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 140/271] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:09 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:09.780866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:09.781606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:09.798898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:09.799603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:09.800166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.801022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:09.806195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:09.806635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:09.839653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] HTTP exception thrown: Instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b could not be found. Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Request method failure captured: Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b HTTP/1.1 Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFwRJlyHg64--H9ouF-74K3NnE634S1mIvpI150PR0GLKgobRsqKiaVNr0FUOXMj1P5N_8KXi0vLrq7kuxFFPm1Vq9Zf-AXx357KbI8kcmg0skHDQmbOEuqjVyQ3C-2YTxnVSzNMqEH22Yy2Uui7HB-n5SrXCyc4EohwEs4B9qOXQng Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 7d030bb54a7c4e489734b7c86b40b464 Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesActionsTest-103324292 Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:16:09.841576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7d030bb54a7c4e489734b7c86b40b464"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7d030bb54a7c4e489734b7c86b40b464"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7d030bb54a7c4e489734b7c86b40b464"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7d030bb54a7c4e489734b7c86b40b464", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesActionsTest-103324292 Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 7d030bb54a7c4e489734b7c86b40b464 Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesActionsTest-103324292 Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesActionsTest-103324292-project Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 1cc519da0b5d40268b29bb1bef89049b Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesActionsTest-103324292-project Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b could not be found. Sep 01 07:16:09.842909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '8ed61ceb-422b-4de0-8284-7ba5c2e55f5b'} Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b could not be found. Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:16:09.843679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b could not be found. Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b could not be found. Sep 01 07:16:09.844861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:16:09.847075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Returning 404 to user: Instance 8ed61ceb-422b-4de0-8284-7ba5c2e55f5b could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:16:09.847075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a754de78-3230-448f-ba99-82bc585a2ec3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b" status: 404 len: 111 microversion: 2.1 time: 0.067302 Sep 01 07:16:09.865734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 132/272] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:09 2022] GET /compute/v2.1/servers/8ed61ceb-422b-4de0-8284-7ba5c2e55f5b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:16:10.048183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1660025647", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "networks": [{"uuid": "a3bab48a-bca2-4bf8-b9ee-cd7fcd899a2d"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:10.657767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:10.658692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:10.672286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:10.673516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:10.674176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:10.674961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:10.675483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:10.675907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:10.860672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:10.870038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ebc8f65e-afc4-482e-ba27-17516bff248a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1510 microversion: 2.1 time: 0.215955 Sep 01 07:16:10.870737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 133/273] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:10 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:10.888589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:10.889578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:10.897968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:10.898866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:10.899360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:10.900129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:10.900642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:10.901147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:10.925457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lazy-loading 'flavor' on Instance uuid 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:16:15.533727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] validate_networks() for [('a3bab48a-bca2-4bf8-b9ee-cd7fcd899a2d', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:16:15.655665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd70be57-2aed-4149-8129-ee1b0f61103a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "POST /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/action" status: 202 len: 0 microversion: 2.20 time: 4.783691 Sep 01 07:16:15.656790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 134/274] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Sep 1 07:16:10 2022] POST /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/action => generated 0 bytes in 4786 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:16:15.663665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:15.665505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:15.681230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:15.681730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:15.682166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:15.683087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:15.683761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:15.684277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:15.966884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:15.980589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3615bdf-7134-4974-865c-17748a91ddd9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1516 microversion: 2.1 time: 0.322218 Sep 01 07:16:15.993412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 135/275] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:15 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:15.993412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf891be9-faf8-444d-a8b1-5950c7a49e00 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Action: 'create', calling method: .version_select at 0x7f78cf411ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-728893866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLSwPntOh8bLphw2MYP4w5A89hwTwmjBWLgzuU9R++MIzPpp/sAp3tAe5GX4uqX3tnUT0PRqI9P1gM6C4F23nHAa/1LNFFXj1u44UWpvkutdX7irB278ZfRxkDmIJisrQ=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:16.009598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-cf891be9-faf8-444d-a8b1-5950c7a49e00 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Getting quotas for project 670ca9b5239a4c5f9aa30faca7a4e519. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:16:16.013909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-cf891be9-faf8-444d-a8b1-5950c7a49e00 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Getting quotas for user 8a537ff040dc4559b103696638cdd9d5 and project 670ca9b5239a4c5f9aa30faca7a4e519. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:16:16.068090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf891be9-faf8-444d-a8b1-5950c7a49e00 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.082493 Sep 01 07:16:16.070001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 136/276] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:16:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:16.075834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:16.076621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:16.080924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:16:16.081617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:16:16.082134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:16:16.082782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:16:16.083525 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:16:16.085393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:16.086630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:16.087438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:16.088651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:16.089455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:16.090101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:16.106171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:16.106662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:16.108044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:16.108792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:16.110665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:16.111099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:16.137689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Getting quotas for project 7d030bb54a7c4e489734b7c86b40b464. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:16:16.148968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Getting quotas for user 1cc519da0b5d40268b29bb1bef89049b and project 7d030bb54a7c4e489734b7c86b40b464. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:16:16.162919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:16:16.166673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:16:16.232797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c006280-7275-4ee6-94dc-008357dc7ea0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.188848 Sep 01 07:16:16.233896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 141/277] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 6190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:16:16.239085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-875436906", "imageRef": "da16417a-5bbd-44a6-8cfb-7698a8ef3bd9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-728893866", "networks": [{"uuid": "1857e393-f1ea-4161-b4cb-e35acd4ed569"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:16.264480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:16.273330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:16.277825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:16.279465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19d1cce9-0c9c-4cf0-ac45-897131538308 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.207735 Sep 01 07:16:16.280617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 137/278] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:16.285688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d7acbd36-6b88-4d19-9190-340ebb5c80da tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:16.286519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d7acbd36-6b88-4d19-9190-340ebb5c80da tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:16.362134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d7acbd36-6b88-4d19-9190-340ebb5c80da tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:16.373942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] validate_networks() for [('1857e393-f1ea-4161-b4cb-e35acd4ed569', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:16:16.382693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d7acbd36-6b88-4d19-9190-340ebb5c80da tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1214 microversion: 2.1 time: 0.100095 Sep 01 07:16:16.384232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 138/279] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:16 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:17.111250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:16:17.112387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:16:17.113497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:16:17.114112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:16:17.114858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:16:17.131353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:17.134561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:17.135687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:17.136510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:17.136975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:17.137446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:17.155792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Getting quotas for project 670ca9b5239a4c5f9aa30faca7a4e519. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:16:17.159684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Getting quotas for user 8a537ff040dc4559b103696638cdd9d5 and project 670ca9b5239a4c5f9aa30faca7a4e519. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:16:17.171000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:16:17.173150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='da16417a-5bbd-44a6-8cfb-7698a8ef3bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:16:17.223615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d63cb787-6b4f-41fd-8e53-f5f79e7b4122 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988281 Sep 01 07:16:17.226549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 142/280] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:16:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:16:17.237342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a76a7fa-afe6-4622-8894-7303517ee3d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:17.238033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a76a7fa-afe6-4622-8894-7303517ee3d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:17.299015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9a76a7fa-afe6-4622-8894-7303517ee3d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:17.311016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:17.311995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:17.321030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:17.321469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a76a7fa-afe6-4622-8894-7303517ee3d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1257 microversion: 2.1 time: 0.088383 Sep 01 07:16:17.321758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:17.322571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:17.322767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 139/281] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1257 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:17.323715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:17.324197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:17.324634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:17.404413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:17.405492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:17.412642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:17.413339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:17.414732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:17.415489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:17.416020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:17.416539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:17.530226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:17.539731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:17.542119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:17.543820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a4aa917b-65e8-4234-a824-cd90a02bd8c1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.236923 Sep 01 07:16:17.546756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:17.548006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 143/282] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:17.554957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7bf7924b-f431-4a2f-be90-a43ce07823b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1266 microversion: 2.1 time: 0.154465 Sep 01 07:16:17.555672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 140/283] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:17 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:17.564157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2bcd7727-fcba-45bc-b522-5c6cf9abfc24 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'create', calling method: .version_select at 0x7f78cf4bd550>, body: {"keypair": {"name": "tempest-keypair-1601860216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORQSovnwhxDJnIvzIAykoAxNZzWHRyX+tR53DCFCuhsmT3ejkGWzHx5JhZ5wGsbRbMuxc/F90b/H8ytmMpeD+P6QBLYxpTRZd/izm+bJ5jLtjtz++wPiDjXwlATeAharQ=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:17.583376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-2bcd7727-fcba-45bc-b522-5c6cf9abfc24 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Getting quotas for project c1705474b7954cf1926e9beb2d548587. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:16:17.592565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-2bcd7727-fcba-45bc-b522-5c6cf9abfc24 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Getting quotas for user db4f0928502a43b490de01afc587a846 and project c1705474b7954cf1926e9beb2d548587. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:16:17.638781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2bcd7727-fcba-45bc-b522-5c6cf9abfc24 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088893 Sep 01 07:16:17.646079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 144/284] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:16:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:18.344019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:18.344765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:18.366858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:18.367654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:18.368087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:18.368899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:18.369617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:18.370286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:18.386466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:18.516966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:18.525160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06282538-4222-432a-9a4f-f150bf78a10b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1309 microversion: 2.1 time: 0.185765 Sep 01 07:16:18.525745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 141/285] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:18.572802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:18.574058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:18.578813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:18.579646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:18.580628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:18.581350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:18.581967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:18.582910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:18.583528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:18.584116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:18.586616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:18.587244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:18.587689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:18.588391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:18.590294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:18.590789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:18.781299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:18.790542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8190222e-4fbc-408e-9f50-9d442e735289 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1272 microversion: 2.1 time: 0.217051 Sep 01 07:16:18.799152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 142/286] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:18 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:19.053239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:19.067105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:19.067105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:19.069004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d13fee30-30b4-466c-9000-9853072166d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.499318 Sep 01 07:16:19.070371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 145/287] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:19.549341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:19.550060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:19.556231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:19.556798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:19.557327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:19.558285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:19.558965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:19.559449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:19.687786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:19.698557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-afefd7ab-fe25-4ef2-8470-446247e619b6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1315 microversion: 2.1 time: 0.153098 Sep 01 07:16:19.699219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 143/288] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:19.834249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:19.835576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:19.845850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:19.853616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:19.854592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:19.855506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:19.859065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:19.859643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:20.095280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:20.096785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:20.107321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:20.108374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:20.109055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:20.110834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:20.111504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:20.113029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:20.274794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:20.304398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-304e8aed-edb7-4d19-8b43-b39724fd211f tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.484123 Sep 01 07:16:20.309035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 146/289] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:19 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:20.719805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:20.720564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:20.726867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:20.727228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:20.728775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:20.730159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:20.730635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:20.731064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:20.879845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:20.892394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:20.895774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c098a264-3652-477e-b14d-6081fa55a5a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1315 microversion: 2.1 time: 0.179605 Sep 01 07:16:20.896859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 147/290] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:20.930808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:20.941954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:20.952464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8dbd9654-f74c-4ddd-a5a5-2457df774b26 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.863502 Sep 01 07:16:20.953741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 144/291] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:16:21.071034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-703230477", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f24c055-6940-48ec-a310-bd5e7c9fb6d1"}], "security_groups": [{"name": "tempest-securitygroup--1625502270"}], "key_name": "tempest-keypair-1601860216", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:21.273449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-fc2b8485-0370-4629-a705-cb237d14746d req-700e3a57-cdfb-408f-bba9-8602365445d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b43ce80-f2e4-4ccc-be3a-82c30015fa8d", "tag": "e91786cf-e0c8-4236-9b1c-bf8b5527251b"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:21.287147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fc2b8485-0370-4629-a705-cb237d14746d req-700e3a57-cdfb-408f-bba9-8602365445d7 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:21.287619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fc2b8485-0370-4629-a705-cb237d14746d req-700e3a57-cdfb-408f-bba9-8602365445d7 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:21.288041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fc2b8485-0370-4629-a705-cb237d14746d req-700e3a57-cdfb-408f-bba9-8602365445d7 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:21.299956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-fc2b8485-0370-4629-a705-cb237d14746d req-700e3a57-cdfb-408f-bba9-8602365445d7 service nova] Creating event network-changed:e91786cf-e0c8-4236-9b1c-bf8b5527251b for instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d on hv-cinder-73306 Sep 01 07:16:21.306450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-fc2b8485-0370-4629-a705-cb237d14746d req-700e3a57-cdfb-408f-bba9-8602365445d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036619 Sep 01 07:16:21.307291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 145/292] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:16:21.329623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:21.330495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:21.341551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:21.342354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:21.343023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:21.344073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:21.346258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:21.346981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:21.700885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:21.708599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec940c62-6121-4c4a-b8ee-573e326bdce2 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.383729 Sep 01 07:16:21.709399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 146/293] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:21 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:21.951686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:21.952353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:21.958070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:21.958539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:21.959334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:21.959648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:21.960086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:21.960500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:22.216744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:22.224683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c54bbcbd-b90a-4995-996b-87f61e8b0323 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.276687 Sep 01 07:16:22.225285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 147/294] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:22.230569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:22.231372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:22.237557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:22.238039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:22.238473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:22.239159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:22.239604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:22.240112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:22.395862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:22.403881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:22.405361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:22.406505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93e540aa-d5ba-4420-a005-52825252982a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.180311 Sep 01 07:16:22.407060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 148/295] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:22.733786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:22.733786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:22.736644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:22.737149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:22.737568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:22.738243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:22.738686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:22.739152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:22.888208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:22.895891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42c21bd0-0eec-4d7e-9085-876a487113d9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.170727 Sep 01 07:16:22.896454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 149/296] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:22 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:22.913375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] validate_networks() for [('9f24c055-6940-48ec-a310-bd5e7c9fb6d1', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:16:23.245434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:23.246034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:23.251837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.252304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.252749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:23.253458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.253900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.254429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:23.288947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:16:23.289435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:16:23.289925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:16:23.290333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:16:23.290738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:16:23.299286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.299769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.300204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:23.300923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.301584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.302008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:23.319206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Getting quotas for project c1705474b7954cf1926e9beb2d548587. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:16:23.323551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Getting quotas for user db4f0928502a43b490de01afc587a846 and project c1705474b7954cf1926e9beb2d548587. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:16:23.334387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:16:23.336553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:16:23.384787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b5c4633-4849-47f4-a42b-14a8d4f00626 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.318032 Sep 01 07:16:23.385670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 148/297] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:16:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 2320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:16:23.390533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-40874762-a2e7-4d92-9a1d-8fe9efe755c5 req-72fe3da6-af44-461e-be29-7964b5667df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ac467b-0a5f-4e70-952c-3bead582e098", "tag": "af5f2bad-da1c-41a1-9b9f-c7eac9bc052a"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:23.395727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:23.401914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-40874762-a2e7-4d92-9a1d-8fe9efe755c5 req-72fe3da6-af44-461e-be29-7964b5667df8 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.402702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-40874762-a2e7-4d92-9a1d-8fe9efe755c5 req-72fe3da6-af44-461e-be29-7964b5667df8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.403230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-40874762-a2e7-4d92-9a1d-8fe9efe755c5 req-72fe3da6-af44-461e-be29-7964b5667df8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:23.404116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-abb0fa58-5c67-4335-bb08-c9f82e6bc85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.162443 Sep 01 07:16:23.404831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 150/298] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:23.415352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-40874762-a2e7-4d92-9a1d-8fe9efe755c5 req-72fe3da6-af44-461e-be29-7964b5667df8 service nova] Creating event network-changed:af5f2bad-da1c-41a1-9b9f-c7eac9bc052a for instance e1ac467b-0a5f-4e70-952c-3bead582e098 on hv-cinder-73306 Sep 01 07:16:23.420299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-40874762-a2e7-4d92-9a1d-8fe9efe755c5 req-72fe3da6-af44-461e-be29-7964b5667df8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033465 Sep 01 07:16:23.420974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 149/299] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:23.424071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31c97b4e-701c-4d21-9fd4-578c08f3bd50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:23.424685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31c97b4e-701c-4d21-9fd4-578c08f3bd50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:23.429450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:23.430234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:23.437010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.437535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.437971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:23.438670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.439119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.439546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:23.482638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31c97b4e-701c-4d21-9fd4-578c08f3bd50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:23.489962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31c97b4e-701c-4d21-9fd4-578c08f3bd50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1245 microversion: 2.1 time: 0.083963 Sep 01 07:16:23.490533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 151/300] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:23.594817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:23.602846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:23.604284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:23.605457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c3cf742-73ab-45d8-89a7-62920855bb7e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.180565 Sep 01 07:16:23.606009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 150/301] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:16:23.916857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:23.917483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:23.923452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.923961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.924391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:23.925069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:23.925552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:23.925968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:24.056388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:24.063890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-264b1aa1-bdae-4582-9790-7bb04a6cb70c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.150891 Sep 01 07:16:24.064442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 152/302] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:23 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:24.425458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:24.426070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:24.432505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:24.432984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:24.433458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:24.434161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:24.434592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:24.435015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:24.511815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:24.512428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:24.518369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:24.518853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:24.519291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:24.519978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:24.520430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:24.520853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:24.572615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:24.580324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4784947-e03c-41fb-a9e7-2da43fcb4466 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.158872 Sep 01 07:16:24.580954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 151/303] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:24 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:24.588052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:24.595834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cbec3273-f151-4d4c-ac00-df751e50aa86 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1249 microversion: 2.1 time: 0.088652 Sep 01 07:16:24.596384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 153/304] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:24.628086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:24.628624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:24.634776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:24.635256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:24.635706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:24.636367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:24.636813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:24.637259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:24.763206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:24.771254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:24.772787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:24.773976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb4d0969-a058-4ba6-994e-c969d0287e9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.149735 Sep 01 07:16:24.774513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 152/305] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:25.084944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:25.085579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:25.091961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:25.092436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:25.092861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:25.093575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:25.094023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:25.094441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:25.224814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:25.234315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18719c8e-103e-4975-a95e-35d1c6f39dfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.152532 Sep 01 07:16:25.235338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 154/306] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:25 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:25.600602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:25.602621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:25.608518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:25.609006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:25.609478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:25.610176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:25.610626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:25.611211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:25.620372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:25.621684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:25.637584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:25.637584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:25.637584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:25.637584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:25.637942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:25.637942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:25.731423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:25.745201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da471b06-53a1-4884-97f0-5b5bd44ebfe1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.128451 Sep 01 07:16:25.757147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 155/307] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:25.797267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:25.798190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:25.805900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:25.806725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:25.807850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:25.808753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:25.809453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:25.810072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:25.852701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:25.856353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:25.861229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f30bd45-bb42-45d2-ae98-585ce3c783a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.264682 Sep 01 07:16:25.874084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 153/308] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:25.984583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:25.994295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:25.995791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:25.996998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d887dd6-b46f-45f9-91c3-e429ae787c48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.204981 Sep 01 07:16:25.997893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 156/309] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:16:26.255715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:26.256330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:26.263225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:26.263716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:26.264157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:26.264855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:26.265361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:26.265792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:26.402304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:26.409988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd52fbd4-b6c7-40b1-b3a0-6ecc8fa26701 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.158125 Sep 01 07:16:26.410554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 154/310] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:26 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:26.767929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:26.768533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:26.774499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:26.774977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:26.775409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:26.776096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:26.776543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:26.776962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:26.839811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:26.847335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34cc8595-8663-4d06-8c94-538e6a005b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.083284 Sep 01 07:16:26.847887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 157/311] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:26.883038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:26.883642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:26.890163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:26.890665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:26.891073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:26.891846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:26.892293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:26.892711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:27.019835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:27.022288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:27.023452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:27.027919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-947cd29a-1670-4f98-a6e9-740799d22f65 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.148859 Sep 01 07:16:27.028492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 155/312] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:27.029770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:27.030329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:27.030828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:27.031593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:27.032125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:27.032548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:27.160986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:27.170342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:27.172009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:27.173185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3a1e2e6-b13d-4eb7-9c8d-0f685c61c207 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.154881 Sep 01 07:16:27.173731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 158/313] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:16:27.430410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:27.431017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:27.432905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:27.438453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:27.438934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:27.439372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:27.440059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:27.440514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:27.440939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:27.573652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:27.583448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c22c0a63-253d-4799-95a2-329eba805ff3 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.157434 Sep 01 07:16:27.584008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 156/314] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:27 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:27.868902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:27.869541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:27.875505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:27.875978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:27.876403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:27.877125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:27.877575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:27.877987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:27.895838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:27.942813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:27.950407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32b4b8bb-5c5f-45ba-86c0-37e21f372e9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.085938 Sep 01 07:16:27.950982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 159/315] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:28.048807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:28.049449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:28.055799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:28.056291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:28.056733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:28.057457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:28.057917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:28.058345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:28.186483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:28.194074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54990fa5-af08-4f16-a11f-45682eaaf659 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.149119 Sep 01 07:16:28.194640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 157/316] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:28.196549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:28.197173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:28.203019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:28.203492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:28.203915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:28.204708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:28.205173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:28.205608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:28.340491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:28.350496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:28.351877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:28.353037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43db9bcb-77b4-4427-b9ba-2f6416bb9e3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.161103 Sep 01 07:16:28.353801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 160/317] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:16:28.604966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:28.605603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:28.611547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:28.612042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:28.612481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:28.613200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:28.613657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:28.614083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:28.740635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:28.748665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fbbde7a-94f1-4f9d-b979-bba146af7ddc tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.147588 Sep 01 07:16:28.749242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 158/318] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:28 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:28.971720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:28.972302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:28.978805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:28.979290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:28.979720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:28.980417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:28.980856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:28.981317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:29.045660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:29.053191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e6e81bf-eb84-4e58-9634-312ed2588f15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.085402 Sep 01 07:16:29.053734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 161/319] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:29.215307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:29.215938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:29.222317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:29.222736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:29.223167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:29.223850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:29.224298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:29.224713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:29.348327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:29.356241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47da2bfa-30d1-4f38-bc68-a739d2b63292 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.145391 Sep 01 07:16:29.356929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 159/320] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:29.375458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:29.376056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:29.381848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:29.382308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:29.383622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:29.384292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:29.384729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:29.385181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:29.516218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:29.524372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:29.525916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:29.527080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f59bd605-eb25-492c-b649-e2ea6900e7e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.155418 Sep 01 07:16:29.527799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 162/321] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:29.770339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:29.770905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:29.779331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:29.780231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:29.780231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:29.780825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:29.781335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:29.781761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:29.957626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:29.967670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bc6ef503-3e22-4cd8-9fee-0ec2e71e6592 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.201247 Sep 01 07:16:29.969995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 160/322] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:29 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:30.074438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:30.075632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:30.082409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:30.082895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:30.083327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:30.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:30.084664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:30.085181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:30.154485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:30.167503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1b69d6d1-b373-442f-a84e-8e798b2ff950 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.097681 Sep 01 07:16:30.181094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 163/323] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:30.377108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:30.377884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:30.385003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:30.385527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:30.385960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:30.386653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:30.387132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:30.387551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:30.528807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:30.537633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56e720ee-012c-49e3-a1b5-f9da1e339b96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.164272 Sep 01 07:16:30.543918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 161/324] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:30.550262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:30.550925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:30.557363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:30.557926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:30.558359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:30.559053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:30.559590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:30.560011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:30.702349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:30.712370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:30.713959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:30.715398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-392a5b87-86a9-4da6-9c9f-6e7c9e1c5c4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.169366 Sep 01 07:16:30.715980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 164/325] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:30.990272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:30.991109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:30.997089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:30.997848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:30.998307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:30.998983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:30.999434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:30.999855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:31.150797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:31.159099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9132ce45-d1b3-4197-a926-c4888c68b59e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.173144 Sep 01 07:16:31.159583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 162/326] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:30 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:31.187750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:31.188383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:31.194589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:31.195377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:31.195835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:31.196846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:31.197498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:31.198140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:31.270995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:31.280314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-528c99dc-ef1c-4ce1-9d15-3b8e1c7aea04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.096184 Sep 01 07:16:31.280956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 165/327] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:31.560427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:31.561732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:31.572403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:31.573459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:31.577550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:31.578516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:31.580113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:31.581606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:31.692924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-68ac0796-0d12-4972-8d4a-ef26c79cf3e4 req-796bbbb5-b940-46cc-99df-1f674c1c75f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b43ce80-f2e4-4ccc-be3a-82c30015fa8d", "name": "network-vif-plugged", "status": "completed", "tag": "e91786cf-e0c8-4236-9b1c-bf8b5527251b"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:31.711392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68ac0796-0d12-4972-8d4a-ef26c79cf3e4 req-796bbbb5-b940-46cc-99df-1f674c1c75f9 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:31.714418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68ac0796-0d12-4972-8d4a-ef26c79cf3e4 req-796bbbb5-b940-46cc-99df-1f674c1c75f9 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:31.721632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68ac0796-0d12-4972-8d4a-ef26c79cf3e4 req-796bbbb5-b940-46cc-99df-1f674c1c75f9 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:31.747856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-68ac0796-0d12-4972-8d4a-ef26c79cf3e4 req-796bbbb5-b940-46cc-99df-1f674c1c75f9 service nova] Creating event network-vif-plugged:e91786cf-e0c8-4236-9b1c-bf8b5527251b for instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d on hv-cinder-73306 Sep 01 07:16:31.773575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-68ac0796-0d12-4972-8d4a-ef26c79cf3e4 req-796bbbb5-b940-46cc-99df-1f674c1c75f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084912 Sep 01 07:16:31.774258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 166/328] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:31.779723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:31.787285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:31.809811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:31.810586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:31.811186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:31.812114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:31.819333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:31.819783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:31.887803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:31.897775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce484939-6aa3-4064-a4df-295012c11a67 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.341011 Sep 01 07:16:31.899014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 163/329] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:32.026165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:32.035601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:32.037906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:32.039891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-655f36d6-465d-4d2b-9be7-a13bc3924153 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.264357 Sep 01 07:16:32.045784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 167/330] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:32.180320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:32.181315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:32.188070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:32.188864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:32.189665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:32.190797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:32.191632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:32.192383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:32.302178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:32.303102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:32.310796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:32.312638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:32.313649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:32.314351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:32.315333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:32.316005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:32.316443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:32.580203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:32.591135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1da42a0b-0d79-434e-b5a9-489314f305e8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.292819 Sep 01 07:16:32.591932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 168/331] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:32.644155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:32.652571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d421484a-1bc3-496f-9581-914b1c7e6b39 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.476544 Sep 01 07:16:32.653251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 164/332] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:32 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:32.919801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:32.920322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:32.926444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:32.926934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:32.927367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:32.928231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:32.928604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:32.929025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:33.065666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:33.066779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:33.074285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:33.075099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:33.075627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:33.076410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:33.077066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:33.077753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:33.083497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:33.101800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3de6ab2-fc16-4757-8996-a84daa080f07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.185199 Sep 01 07:16:33.121189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 169/333] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:33.309613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:33.326270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:33.336422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=22 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:33.355243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:33.359921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:33.361552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e48d4ce1-56f9-4d4d-a96c-f051c5a8b154 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.301436 Sep 01 07:16:33.362252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 165/334] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:33.611796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:33.612541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:33.614436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:33.619744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:33.620225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:33.620837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:33.621561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:33.622028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:33.622680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:33.673779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:33.674419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:33.681947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:33.682677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:33.686346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:33.687272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:33.687919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:33.689579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:33.691913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:33.700513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64573650-e555-449f-b1bb-9f37ea56044b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.092523 Sep 01 07:16:33.714137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 170/335] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:33.864619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:33.872391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fcac782b-264e-4219-b501-f798d07e89be tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.202680 Sep 01 07:16:33.872957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 166/336] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:33 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:34.123220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:34.123991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:34.130456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:34.131026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:34.131539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:34.132313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:34.133438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:34.133933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:34.286556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:34.295058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b216b8d7-1927-42c1-b2c5-ccfad75d7722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.175673 Sep 01 07:16:34.296174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 171/337] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:34.387650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:34.388186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:34.394249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:34.394748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:34.395190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:34.395895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:34.396354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:34.396780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:34.536709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:34.545715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:34.547540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:34.548966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01cc7aff-65c5-44d3-bad3-4c9218c3fc59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.166661 Sep 01 07:16:34.551249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 167/338] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:34.721815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:34.722400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:34.728347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:34.728831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:34.729295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:34.729987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:34.730436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:34.730863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:34.800358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:34.808330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-45958c1d-dc45-455c-bf88-e1d7f947ae52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.090791 Sep 01 07:16:34.808885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 172/339] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:34.893749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:34.894361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:34.901158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:34.901647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:34.902084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:34.902770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:34.903224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:34.903650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:35.032289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:35.040158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-240670af-0105-43ec-9533-7e2cd4b7868e tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.150255 Sep 01 07:16:35.040726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 168/340] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:34 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:35.316156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:35.316876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:35.323481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:35.324087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:35.324623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:35.325429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:35.325912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:35.326326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:35.471475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:35.480138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62ab954d-b948-4880-86b9-4c0b9233f48a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.168137 Sep 01 07:16:35.480744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 173/341] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:35.575524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:35.576298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:35.582813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:35.583395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:35.583911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:35.584711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:35.585284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:35.586320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:35.727648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:35.736028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:35.737738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:35.738908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0571f0dc-413f-4d52-aa53-d0adf0503422 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.167322 Sep 01 07:16:35.739641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 169/342] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:35.828056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:35.828752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:35.834875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:35.835428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:35.836001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:35.837737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:35.837737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:35.837737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:35.909657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:35.918278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-462d3cf1-9553-412d-bc3d-1ee4e17c1faf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.094029 Sep 01 07:16:35.918854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 174/343] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:36.062974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:36.064062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:36.071178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:36.071753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:36.072257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:36.073027 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:36.073575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:36.074063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:36.092780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:36.210645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:36.218794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-783193e9-1b4f-4df9-9fb7-a6450f7e71a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.159643 Sep 01 07:16:36.219365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 170/344] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:36 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:36.500472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:36.501080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:36.507105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:36.508106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:36.508537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:36.509280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:36.509731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:36.510151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:36.656020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:36.664362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-81a5eaad-af78-4c6e-9d84-5d623a618d6f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.167177 Sep 01 07:16:36.665027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 175/345] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:36.762861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:36.763503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:36.769698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:36.770195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:36.770637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:36.771364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:36.772196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:36.772626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:36.904448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:36.912511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:36.914545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:36.915702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76c2c62a-e6f6-494f-a4c2-fb64e1f5cd60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.157680 Sep 01 07:16:36.916436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 171/346] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:36.940507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:36.941172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:36.947249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:36.947736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:36.948170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:36.948863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:36.949338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:36.949892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:37.020900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:37.024740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:37.029600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad4b43cb-69f1-413b-91b7-5a23b3b3f016 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.093611 Sep 01 07:16:37.030342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 176/347] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:37.238837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:37.239588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:37.246919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:37.247919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:37.248458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:37.249277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:37.249809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:37.250309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:37.408337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:37.416482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0935fd2f-1bcc-448e-8053-90c526519e76 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.181478 Sep 01 07:16:37.417233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 172/348] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:37 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:37.686034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:37.686762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:37.692769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:37.693341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:37.693842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:37.694606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:37.695777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:37.696256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:37.830611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:37.838614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e99bcb0-7cf6-4184-beaa-4707e34b113a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.156971 Sep 01 07:16:37.839173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 177/349] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:37.944335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:37.945577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:37.951902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:37.952565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:37.953221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:37.956632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:37.957109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:37.958280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:38.052368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:38.053727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:38.060579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:38.061339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:38.061964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:38.062958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:38.063558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:38.064141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:38.156094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:38.167786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0fabd013-1242-4990-930f-01c5ed549c53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.119604 Sep 01 07:16:38.168652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 178/350] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:38.168971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:38.177387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:38.178836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:38.180095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e4264f7-300a-4ce8-9640-18505fdda9ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.240224 Sep 01 07:16:38.180663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 173/351] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:38.437939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:38.438540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:38.444422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:38.445046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:38.446027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:38.446765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:38.447217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:38.447638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:38.584317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:38.592087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b24c3f3-21ac-4fc0-87ef-0caa005aa783 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.157927 Sep 01 07:16:38.592997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 179/352] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:38 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:38.859775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:38.860465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:38.867674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:38.868196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:38.868598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:38.869380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:38.869851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:38.870272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:39.001843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:39.010208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a478833c-2a22-4066-aefb-12877daaede9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.154367 Sep 01 07:16:39.010791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 174/353] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:39.188598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:39.189192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:39.195692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:39.196211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:39.196651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:39.197380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:39.197824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:39.198232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:39.203855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:39.204550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:39.210563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:39.211127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:39.211639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:39.212428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:39.212955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:39.213595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:39.317981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:39.327055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e29ff4b7-e768-4740-8a63-8f730dd0746e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.142339 Sep 01 07:16:39.327629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 180/354] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:39.422513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:39.432007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:39.433493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:39.434694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-61c8bff5-c3ad-4f5c-a3cb-3caa9a4da688 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1724 microversion: 2.20 time: 0.234686 Sep 01 07:16:39.435245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 175/355] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:39.612256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:39.612904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:39.618813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:39.619277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:39.619699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:39.620359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:39.620795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:39.621232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:39.747786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:39.755464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d1a5c64-48f1-4c11-966b-349e703d5f7c tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.147051 Sep 01 07:16:39.756028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 181/356] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:39 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:40.030436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:40.031048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:40.037343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:40.037838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:40.038279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:40.039553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:40.040009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:40.040434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:40.193967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:40.201939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a66eca48-0f32-4782-9d00-2750d5214a09 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.175401 Sep 01 07:16:40.202495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 176/357] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:40.347564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:40.348199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:40.354638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:40.355117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:40.355544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:40.356219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:40.356659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:40.357069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:40.417737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:40.425343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c868565-34f5-40a6-aec9-2fa6d05f3809 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1297 microversion: 2.1 time: 0.081714 Sep 01 07:16:40.425908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 182/358] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:40.457219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:40.457832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:40.463711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:40.464200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:40.464638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:40.465361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:40.465824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:40.466251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:40.594564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:40.603070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:40.604494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:40.605667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8aada5b1-c769-416e-b74f-fb24276f043e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1745 microversion: 2.20 time: 0.152355 Sep 01 07:16:40.606223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 177/359] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:40.776481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:40.777082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:40.782910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:40.783383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:40.783804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:40.784483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:40.784919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:40.785352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:40.914351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:40.921836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c86cd68-a03b-4cd3-bfc8-5e224e1fdb4a tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.149706 Sep 01 07:16:40.922387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 183/360] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:40 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:41.224663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:41.225431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:41.232693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:41.233594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:41.234442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:41.236172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:41.236804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:41.237419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:41.446052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:41.446768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:41.453874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:41.454624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:41.456267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:41.457214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:41.457903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:41.458420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:41.523566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:41.532753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8d2733b-38b2-483f-9819-55565cfefb7b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.313378 Sep 01 07:16:41.533809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 178/361] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:41.548524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:41.558646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25f4a0d5-e56b-47dc-82a6-a2a67e26ea77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1303 microversion: 2.1 time: 0.116582 Sep 01 07:16:41.559797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 184/362] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:41.629040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:41.629686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:41.636327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:41.636821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:41.637305 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:41.638004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:41.638463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:41.638888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:41.827278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:41.835322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:41.836761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:41.837946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4142c8ad-abbb-4512-b16e-5ad9ed276645 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1745 microversion: 2.20 time: 0.213648 Sep 01 07:16:41.838492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 179/363] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:41.942139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:41.942739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:41.949288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:41.949763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:41.950189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:41.950865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:41.951312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:41.951728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:42.077017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:42.085625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2eafa7c-7153-4cc9-b878-361598e554b9 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1314 microversion: 2.1 time: 0.147177 Sep 01 07:16:42.086380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 185/364] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:41 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:42.557487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:42.557979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:42.564196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:42.564682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:42.565139 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:42.565815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:42.566265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:42.566677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:42.581349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:42.581882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:42.589197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:42.589899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:42.590604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:42.591590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:42.592190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:42.592755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:42.679608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:42.689940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db9d496c-ecf6-4da4-b2d4-a203f6c6f6a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1303 microversion: 2.1 time: 0.112793 Sep 01 07:16:42.703737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 186/365] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:42.754432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:42.765714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-82d7de69-6178-4d94-8568-7b5aa1f47fa0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.212108 Sep 01 07:16:42.766785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 180/366] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:42.860736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:42.861662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:42.869513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:42.870073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:42.870740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:42.871664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:42.872311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:42.873090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:43.018732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:43.028187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:43.029982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:43.031256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-395f209c-fb44-4dce-afc9-7f0eb5590c8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1745 microversion: 2.20 time: 0.174994 Sep 01 07:16:43.031994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 187/367] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:43.109281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:43.110771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:43.120321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:43.121070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:43.121929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:43.122802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:43.123742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:43.124359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:43.340190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:43.348025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-33572498-943b-4dfe-9237-3da5a73855ea tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1498 microversion: 2.1 time: 0.245277 Sep 01 07:16:43.348575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 181/368] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:43 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:43.662809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-30ea0b4b-0473-44f8-9f6f-87a04f9ebcde req-4463d48c-36fc-4da9-905a-1ea5783ed08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179bc01d-7bec-423c-8b0f-170bfa0d6ab0", "name": "network-vif-plugged", "status": "completed", "tag": "a391aacc-abe6-4876-aa12-6c9d9b026042"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:43.685502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-30ea0b4b-0473-44f8-9f6f-87a04f9ebcde req-4463d48c-36fc-4da9-905a-1ea5783ed08b service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:43.686171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-30ea0b4b-0473-44f8-9f6f-87a04f9ebcde req-4463d48c-36fc-4da9-905a-1ea5783ed08b service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:43.688319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-30ea0b4b-0473-44f8-9f6f-87a04f9ebcde req-4463d48c-36fc-4da9-905a-1ea5783ed08b service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:43.710643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-30ea0b4b-0473-44f8-9f6f-87a04f9ebcde req-4463d48c-36fc-4da9-905a-1ea5783ed08b service nova] Creating event network-vif-plugged:a391aacc-abe6-4876-aa12-6c9d9b026042 for instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 on hv-cinder-73306 Sep 01 07:16:43.716178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-30ea0b4b-0473-44f8-9f6f-87a04f9ebcde req-4463d48c-36fc-4da9-905a-1ea5783ed08b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069353 Sep 01 07:16:43.716942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 188/369] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:43.717270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:43.718026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:43.739183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:43.741651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:43.742364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:43.743741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:43.744224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:43.744663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:43.789989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:43.790801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:43.797569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:43.798179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:43.798791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:43.802090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:43.802575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:43.803017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:44.067408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:44.083812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dc480cb7-18ca-46d1-9021-116aacd1f2b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.375205 Sep 01 07:16:44.085187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 182/370] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:44.101696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:44.102522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:44.115353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:44.116009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:44.116577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:44.121750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:44.122503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:44.123190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:44.127997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:44.142480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51e2a0c2-73db-4235-addb-ae6a6c2e5edc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.358430 Sep 01 07:16:44.160039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 189/371] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:44.279177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:44.279894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:44.292373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:44.293013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:44.293576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:44.294504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:44.295065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:44.295597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:44.394769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:16:44.506956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:44.519475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:44.521137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:44.522499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0b6b5a6-ad78-44fe-a10f-b70510035438 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1745 microversion: 2.20 time: 0.435921 Sep 01 07:16:44.523792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 183/372] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1745 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:44.544873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff07b3fe-b718-4a5c-a034-a3e7199105d0 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 204 len: 0 microversion: 2.1 time: 0.269544 Sep 01 07:16:44.545699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 190/373] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:16:44 2022] DELETE /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 07:16:44.556524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:44.557706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:44.575977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:44.589370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:44.589370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:44.589370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:44.589370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:44.589764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:44.826470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:44.835486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9b29387f-cb0a-491b-9b8c-c2b933d5ddfa tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1504 microversion: 2.1 time: 0.285501 Sep 01 07:16:44.836168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 184/374] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:44 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:44.932384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c901722f-fa2f-45fd-a0b9-35f3c4bb3729 req-ad641ee1-a48c-4431-b91d-c6374c178373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56872759-8d04-492f-8020-a8143079785a", "tag": "4a7088df-c8f1-43bf-9d2a-48042b8faf52"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:44.943243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c901722f-fa2f-45fd-a0b9-35f3c4bb3729 req-ad641ee1-a48c-4431-b91d-c6374c178373 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:44.946876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c901722f-fa2f-45fd-a0b9-35f3c4bb3729 req-ad641ee1-a48c-4431-b91d-c6374c178373 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:44.947557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c901722f-fa2f-45fd-a0b9-35f3c4bb3729 req-ad641ee1-a48c-4431-b91d-c6374c178373 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:44.958955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c901722f-fa2f-45fd-a0b9-35f3c4bb3729 req-ad641ee1-a48c-4431-b91d-c6374c178373 service nova] Creating event network-changed:4a7088df-c8f1-43bf-9d2a-48042b8faf52 for instance 56872759-8d04-492f-8020-a8143079785a on hv-cinder-73306 Sep 01 07:16:44.964405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c901722f-fa2f-45fd-a0b9-35f3c4bb3729 req-ad641ee1-a48c-4431-b91d-c6374c178373 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037346 Sep 01 07:16:44.965071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 191/375] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:45.105047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:45.105679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:45.111509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:45.111996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:45.112427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:45.113133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:45.115964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:45.116420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:45.168819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:45.169661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:45.176297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:45.176983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:45.177512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:45.178193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:45.178822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:45.179797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:45.546021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:45.555281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ef12635c-22e5-48f9-b38e-f0eef67f7e38 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.454384 Sep 01 07:16:45.555868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 185/376] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:45.560648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:45.561462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:45.567749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:45.568434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:45.569016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:45.570716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:45.571474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:45.571990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:45.587609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:45.596176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86918d2b-fa43-4952-bd1a-63d7438d178f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.433001 Sep 01 07:16:45.596745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 192/377] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:45.736357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:45.745110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:45.746576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:45.747724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c9109ab0-f265-4039-b86b-45fd325830f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1745 microversion: 2.20 time: 0.190773 Sep 01 07:16:45.748279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 186/378] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:45.856389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:45.856992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:45.862840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:45.863318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:45.863747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:45.864427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:45.864867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:45.865322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:45.869862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:45.994257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:46.001762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb5f189c-70f9-40f8-b2a8-4553079f10a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1504 microversion: 2.1 time: 0.149190 Sep 01 07:16:46.002312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 193/379] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:45 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:46.576144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:46.576812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:46.582950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:46.583861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:46.584299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:46.585013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:46.586141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:46.586561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:46.590505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:46.616233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:46.616836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:46.622790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:46.623199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:46.623622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:46.624295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:46.624733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:46.625165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:46.763482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:46.771642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e51d60b-e93c-4c54-8e49-5b7551fb2054 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.199211 Sep 01 07:16:46.772224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 187/380] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:46.776785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:46.777423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:46.783207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:46.783688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:46.784120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:46.785021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:46.785506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:46.785928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:46.793053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:46.800992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8180fa21-6946-4540-bcb7-c9971e65e5ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.188439 Sep 01 07:16:46.802072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 194/381] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:46.910767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:46.919246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:46.920690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:46.921879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7eefe511-d52f-40d5-bf6c-dd5f61633f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1745 microversion: 2.20 time: 0.148747 Sep 01 07:16:46.922435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 188/382] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:47.022730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:47.023825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:47.029699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:47.030175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:47.030602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:47.031277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:47.031719 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:47.032164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:47.159256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:47.167521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb0a0a4c-b97c-49f3-9fcc-35931a7ef517 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1504 microversion: 2.1 time: 0.148637 Sep 01 07:16:47.168072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 195/383] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:47 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:47.791620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:47.792227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:47.798482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:47.798957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:47.799388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:47.800069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:47.800518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:47.800942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:47.825261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:47.826229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:47.832528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:47.833402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:47.834292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:47.835256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:47.836028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:47.836628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:48.109008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:48.117409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-595bf8f3-627f-418c-8257-111977f633ed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.328904 Sep 01 07:16:48.118069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 189/384] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:48.122548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:48.123419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:48.129596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:48.130162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:48.130598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:48.131517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:48.131974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:48.132433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:48.134028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:48.155361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7797710-8356-46d2-b006-9c7e6eed7a61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.335689 Sep 01 07:16:48.156332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 196/385] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:48.189615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:48.190726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:48.197800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:48.198292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:48.199096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:48.200221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:48.201030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:48.201643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:48.535851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:48.559207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:48.563047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:48.568438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c37736f5-17c4-4688-8ec4-0154b40f1960 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.449322 Sep 01 07:16:48.572488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 190/386] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:48.640552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:48.648177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f60bc279-51a7-4d0e-8b80-d68bdc42d027 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1504 microversion: 2.1 time: 0.463956 Sep 01 07:16:48.648744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 197/387] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:48 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:49.138851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:49.140939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:49.156028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.173078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.175999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.178572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.181370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.182642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.184526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:49.185152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:49.196091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.196091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.196091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.197636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.199552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.200376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.510549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:49.526628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:49.538384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dbf20fd2-6e67-4078-8c98-8ba690d7363d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.363872 Sep 01 07:16:49.539581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-02fdade6-ab26-4687-acba-2eda50372f05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.402260 Sep 01 07:16:49.554062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 198/388] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:49.555261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 191/389] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:49.560024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-673b5ac5-9456-477c-b665-edb0022f4fca req-99824cfb-3797-4c49-8dba-e6ef68e03790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b43ce80-f2e4-4ccc-be3a-82c30015fa8d", "name": "network-vif-deleted", "tag": "e91786cf-e0c8-4236-9b1c-bf8b5527251b"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:49.581149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-673b5ac5-9456-477c-b665-edb0022f4fca req-99824cfb-3797-4c49-8dba-e6ef68e03790 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.581149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-673b5ac5-9456-477c-b665-edb0022f4fca req-99824cfb-3797-4c49-8dba-e6ef68e03790 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.581149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-673b5ac5-9456-477c-b665-edb0022f4fca req-99824cfb-3797-4c49-8dba-e6ef68e03790 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.589687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-673b5ac5-9456-477c-b665-edb0022f4fca req-99824cfb-3797-4c49-8dba-e6ef68e03790 service nova] Creating event network-vif-deleted:e91786cf-e0c8-4236-9b1c-bf8b5527251b for instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d on hv-cinder-73306 Sep 01 07:16:49.596016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-673b5ac5-9456-477c-b665-edb0022f4fca req-99824cfb-3797-4c49-8dba-e6ef68e03790 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039845 Sep 01 07:16:49.596746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 199/390] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:49.598087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:49.599295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:49.606690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.607421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.608025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.608938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.609583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.610383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.636023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b7ffbbb1-3311-4c36-97c2-1922b44c29d1 req-12a7ef1f-1548-4eae-a6cb-e3ca38c4be8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ac467b-0a5f-4e70-952c-3bead582e098", "name": "network-vif-plugged", "status": "completed", "tag": "af5f2bad-da1c-41a1-9b9f-c7eac9bc052a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:16:49.660692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7ffbbb1-3311-4c36-97c2-1922b44c29d1 req-12a7ef1f-1548-4eae-a6cb-e3ca38c4be8d service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.662866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7ffbbb1-3311-4c36-97c2-1922b44c29d1 req-12a7ef1f-1548-4eae-a6cb-e3ca38c4be8d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.663558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7ffbbb1-3311-4c36-97c2-1922b44c29d1 req-12a7ef1f-1548-4eae-a6cb-e3ca38c4be8d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.679507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b7ffbbb1-3311-4c36-97c2-1922b44c29d1 req-12a7ef1f-1548-4eae-a6cb-e3ca38c4be8d service nova] Creating event network-vif-plugged:af5f2bad-da1c-41a1-9b9f-c7eac9bc052a for instance e1ac467b-0a5f-4e70-952c-3bead582e098 on hv-cinder-73306 Sep 01 07:16:49.685159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b7ffbbb1-3311-4c36-97c2-1922b44c29d1 req-12a7ef1f-1548-4eae-a6cb-e3ca38c4be8d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058023 Sep 01 07:16:49.686691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 200/391] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:49.691847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:49.693077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:49.700485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.701347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.702553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.704067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:49.705156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:49.706143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:49.793873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:49.801511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:49.804114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-868d78ec-b44b-42ef-b0d0-20807e56d788 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1462 microversion: 2.1 time: 0.116009 Sep 01 07:16:49.807521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 201/392] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:49 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1462 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:49.811496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:49.813881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:49.815088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5e273eda-d8e3-4d25-b5fc-ae04824708a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.224159 Sep 01 07:16:49.815635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 192/393] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:50.560901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:50.562277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:50.565199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:50.566749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:50.575336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:50.576352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:50.577023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:50.578002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:50.578773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:50.579409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:50.581261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:50.581951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:50.582556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:50.583420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:50.584036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:50.584609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:50.817425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:50.823020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:50.826787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67c242cc-af01-4a40-9bc6-d06fbc0ede87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.265532 Sep 01 07:16:50.827775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 193/394] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:50.832519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:50.833267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:50.843232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:50.844105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:50.844763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:50.845365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02eef9c7-52c2-4deb-a3ea-910e66b8436e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.288449 Sep 01 07:16:50.845836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:50.846387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:50.847021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:50.858075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 202/395] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:50.865379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:50.866261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:50.872961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:50.873718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:50.874318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:50.875211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:50.875820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:50.876400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:50.921044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:50.934507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0fe48c2f-2c6b-422b-950d-38f88b3878a5 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1462 microversion: 2.1 time: 0.105450 Sep 01 07:16:50.945500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 194/396] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:50 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1462 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:51.047263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:51.055633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:51.057058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:51.058293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1eb0b1d4-278d-4918-aac2-b1aeb5e2fc31 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.199139 Sep 01 07:16:51.065798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 203/397] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:51.852066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:51.852684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:51.859670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:51.860379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:51.861248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:51.862340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:51.863290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:51.863723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:51.871585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:51.872332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:51.879153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:51.882718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:51.883845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:51.884898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:51.885514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:51.886313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:52.087736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:52.101909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:52.105984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5d777b85-845c-4e0b-aca2-e92d57749b9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.250893 Sep 01 07:16:52.122570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 195/398] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:52.125378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f21689db-3a71-4a25-8f37-7da0e003547d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.257616 Sep 01 07:16:52.127407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:52.128021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:52.137094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:52.137621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:52.138088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:52.138803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 204/399] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:52.138955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:52.139323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:52.139757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:52.149597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:52.150409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:52.157543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:52.158268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:52.158799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:52.159683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:52.161079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:52.161631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:52.217768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:52.230524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d753f751-2929-4e10-81bf-da7450592d88 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1462 microversion: 2.1 time: 0.102235 Sep 01 07:16:52.231746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 196/400] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:52 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1462 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:52.354560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:52.364282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:52.366055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:52.367743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ba93cc29-e2ee-4951-8a06-13096ad5b2aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.223982 Sep 01 07:16:52.368428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 205/401] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:53.128540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:53.130119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:53.143727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.144504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.145834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.147109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.151567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:53.152402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:53.152643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.153093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.163600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.164228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.164719 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.165493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.165948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.166374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.652572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:53.676303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9dd2c0b7-722a-448f-a076-5fe335b29ba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.552705 Sep 01 07:16:53.690613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 197/402] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:53.706264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:53.707361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:53.725443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:53.744134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-563c5813-2a21-4780-83b1-27a1ecb25188 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.595433 Sep 01 07:16:53.747936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.760632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.763470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 206/403] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:53.765819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.768806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.771632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.773444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.787216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:53.791875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:53.804827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.805384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.805784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.814673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.815549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.816634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.833712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:53.834533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:53.835889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:53.836969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lazy-loading 'fault' on Instance uuid 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:16:53.926764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc519da0b5d40268b29bb1bef89049b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d030bb54a7c4e489734b7c86b40b464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:53.936407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6715090c-be4b-4903-97aa-22fa93d6be45 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 200 len: 1304 microversion: 2.1 time: 0.240992 Sep 01 07:16:53.937451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 198/404] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:53 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 1304 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:54.035394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:54.046063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:54.047899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:54.049506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e93fb5ec-c5f6-4e43-b68a-48e0423a265d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.284664 Sep 01 07:16:54.050421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 207/405] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:54.704557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:54.705382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:54.720015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:54.721087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:54.721821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:54.722685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:54.723362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:54.723886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:54.780567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:54.784749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:54.801710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:54.802378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:54.818579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:54.819377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:54.820466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:54.820898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:55.005345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:55.021887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e2c86efc-c4b5-4244-9129-0b27760008d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.321551 Sep 01 07:16:55.022947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 199/406] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:16:55.027799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:55.030344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] [instance: 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:55.050185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:55.050688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:55.051135 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:55.051846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:55.052374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:55.062244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:55.097458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] HTTP exception thrown: Instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d could not be found. Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Request method failure captured: Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d HTTP/1.1 Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFwRJlyHg64--H9ouF-74K3NnE634S1mIvpI150PR0GLKgobRsqKiaVNr0FUOXMj1P5N_8KXi0vLrq7kuxFFPm1Vq9Zf-AXx357KbI8kcmg0skHDQmbOEuqjVyQ3C-2YTxnVSzNMqEH22Yy2Uui7HB-n5SrXCyc4EohwEs4B9qOXQng Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 7d030bb54a7c4e489734b7c86b40b464 Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesActionsTest-103324292 Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:16:55.103510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7d030bb54a7c4e489734b7c86b40b464"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7d030bb54a7c4e489734b7c86b40b464"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7d030bb54a7c4e489734b7c86b40b464"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7d030bb54a7c4e489734b7c86b40b464", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesActionsTest-103324292 Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 7d030bb54a7c4e489734b7c86b40b464 Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesActionsTest-103324292 Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesActionsTest-103324292-project Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 1cc519da0b5d40268b29bb1bef89049b Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesActionsTest-103324292-project Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d could not be found. Sep 01 07:16:55.104980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '1b43ce80-f2e4-4ccc-be3a-82c30015fa8d'} Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d could not be found. Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:16:55.105757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d could not be found. Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d could not be found. Sep 01 07:16:55.107018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:16:55.108104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] Returning 404 to user: Instance 1b43ce80-f2e4-4ccc-be3a-82c30015fa8d could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:16:55.108104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6202fd2-ab60-4d2f-b237-d29e41984d54 tempest-VolumesActionsTest-103324292 tempest-VolumesActionsTest-103324292-project] 10.222.0.46 "GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d" status: 404 len: 111 microversion: 2.1 time: 0.080988 Sep 01 07:16:55.108104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 200/407] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:55 2022] GET /compute/v2.1/servers/1b43ce80-f2e4-4ccc-be3a-82c30015fa8d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:16:55.113971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:55.114695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:55.130112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:55.130614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:55.131058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:55.131842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:55.132396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:55.132829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:55.141365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:55.153627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02f5db66-d43d-4730-8942-49ec7daa0e27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1357 microversion: 2.1 time: 0.376761 Sep 01 07:16:55.154296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 208/408] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1357 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:55.358580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:55.370887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:55.381713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:55.384989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19009365-76bc-48d9-b028-3a9ade87131d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.278100 Sep 01 07:16:55.390143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 201/409] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:56.053429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:56.054771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:56.070454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:56.070991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:56.071840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:56.073767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:56.074094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:56.074520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:56.181956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:56.183544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:56.193837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:56.195832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:56.196491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:56.199021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:56.201761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:56.202575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:56.598023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:56.613499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d36f2f8e-de14-4f58-9795-76ed91963c8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.568304 Sep 01 07:16:56.619099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 209/410] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:56.636355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:56.638366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:56.654847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:56.655590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:56.659347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:56.660334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:56.660961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:56.662183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:56.722408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:56.736462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47fd5926-9322-40ac-bc64-1d7c15f57785 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1547 microversion: 2.1 time: 0.559132 Sep 01 07:16:56.737915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 202/411] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1547 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:56.759284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:56.759903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:56.784085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:56.789420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:56.789968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:56.790817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:56.791302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:56.791760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:56.891061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:56.905889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:56.909458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:56.915889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cb77827-50ae-4620-b92e-b98349a2cc3c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.294897 Sep 01 07:16:56.916469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 210/412] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:57.135206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:57.143643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fde4073-a984-4be1-9ef8-e4050749615d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1547 microversion: 2.1 time: 0.388662 Sep 01 07:16:57.144235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 203/413] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1547 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:57.166382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:57.173838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:57.174861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Searching by: {'deleted': False, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519'} {{(pid=120637) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 07:16:57.185195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:57.186045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:57.186974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:57.188152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:57.188943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:57.189602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:57.353981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:57.404317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.multi_cell_list [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 07:16:57.642976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:57.643661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:57.661719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:57.664673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:57.665398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:57.666396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:57.667743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:57.670650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97c75349-3015-4bab-8227-1b59ca52dae8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.501637 Sep 01 07:16:57.671314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 211/414] 10.222.0.46 () {58 vars in 1125 bytes} [Thu Sep 1 07:16:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:16:57.672577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:57.672960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:57.679870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:16:57.688056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:57.688679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:57.707803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:57.708303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:57.709602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:57.710885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:57.711349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:57.711778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:58.248293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:58.256391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-199a102c-d68a-404f-8aeb-7a609f2a23c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.618374 Sep 01 07:16:58.256970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 204/415] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:58.287947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:58.289163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:58.301237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:58.302057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:58.302499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:58.303208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:58.303661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:58.304123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:58.314245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:58.325621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff8eb273-91e1-41e4-9915-0bd22b141ccf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1547 microversion: 2.1 time: 0.645395 Sep 01 07:16:58.326792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 212/416] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1547 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:58.499100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:58.508504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:58.511365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:58.513777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b43eda7f-4160-4f72-99f4-d4b02e42a7ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.251924 Sep 01 07:16:58.515130 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 205/417] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:16:59.281207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:59.281849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:59.288694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:59.289468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:59.290305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:59.291188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:59.291927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:59.292524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:59.550281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:16:59.552525 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:16:59.563282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:59.563950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:59.564712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:59.565966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:16:59.566750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:16:59.567521 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:16:59.570929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:59.587954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f74ec49-7fe3-4906-a9a2-63ec86f15a03 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.310677 Sep 01 07:16:59.589413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 213/418] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:16:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:16:59.805454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:59.816957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:59.823210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:16:59.824785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e6582739-3fe4-4691-8a1c-788b862c94b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.288718 Sep 01 07:16:59.826412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 206/419] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:16:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:00.611490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:00.612105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:00.613425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-879477f4-228d-41cb-a717-1144c8492299 req-52bdd96d-6f05-4c57-854d-52fc311fe959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56872759-8d04-492f-8020-a8143079785a", "name": "network-vif-plugged", "status": "completed", "tag": "4a7088df-c8f1-43bf-9d2a-48042b8faf52"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:00.620897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:00.621478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:00.621768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:00.625575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:00.626240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:00.626842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:00.636087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-879477f4-228d-41cb-a717-1144c8492299 req-52bdd96d-6f05-4c57-854d-52fc311fe959 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:00.640188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-879477f4-228d-41cb-a717-1144c8492299 req-52bdd96d-6f05-4c57-854d-52fc311fe959 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:00.640618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-879477f4-228d-41cb-a717-1144c8492299 req-52bdd96d-6f05-4c57-854d-52fc311fe959 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:00.676330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-879477f4-228d-41cb-a717-1144c8492299 req-52bdd96d-6f05-4c57-854d-52fc311fe959 service nova] Creating event network-vif-plugged:4a7088df-c8f1-43bf-9d2a-48042b8faf52 for instance 56872759-8d04-492f-8020-a8143079785a on hv-cinder-73306 Sep 01 07:17:00.715237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-879477f4-228d-41cb-a717-1144c8492299 req-52bdd96d-6f05-4c57-854d-52fc311fe959 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085237 Sep 01 07:17:00.715842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 207/420] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:17:00.813775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:00.822323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-380f9330-e257-4872-9c5e-5728c3e7c6a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.216322 Sep 01 07:17:00.823490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 214/421] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:00.853441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:00.854991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:00.863061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:00.864029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:00.864998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:00.866088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:00.866810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:00.867578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:01.074045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:01.092228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:01.095199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:01.096637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f57803fe-6119-4ce4-9d1a-a7adf296463b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1740 microversion: 2.20 time: 0.249757 Sep 01 07:17:01.098582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 208/422] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:01.279694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18802add-a9b8-4a4b-be55-a832bf196f14"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:01.282474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:01.285506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:01.289625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:01.290105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:01.290554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:01.291198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:01.291638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:01.292052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:01.849443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:01.851384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:01.860030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:01.861255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:01.862106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:01.863608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:01.864501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:01.865289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:02.059879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29b07768-acd5-4371-ac23-7c624800f96f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785905 Sep 01 07:17:02.067176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 215/423] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:17:01 2022] POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:02.104785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1257475994", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "networks": [{"uuid": "3ff513bc-8cfa-41bb-9f08-487806c0a2e2"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:02.144403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:02.153008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-687d2f35-4879-4540-a3cb-cab4577b7c31 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.308993 Sep 01 07:17:02.153630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 209/424] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:17:02.158180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:02.158784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:02.164975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:02.165559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:02.166005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:02.166782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:02.167268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:02.167744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:02.187225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] validate_networks() for [('3ff513bc-8cfa-41bb-9f08-487806c0a2e2', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:17:02.507517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:02.519482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:02.521232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:02.523341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4aa6a6d3-e60a-447d-a4cd-99c24ac3df15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1722 microversion: 2.20 time: 0.368111 Sep 01 07:17:02.524228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 210/425] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:02.814944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:17:02.815387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:17:02.816099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:17:02.816523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:17:02.817104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:17:02.827765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:02.828474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:02.829084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:02.830273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:02.831062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:02.831712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:02.851632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Getting quotas for project 7170a1232ab14cd4aff705e91364d5c1. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:17:02.855681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Getting quotas for user c6a74f33e6e941ed8c3f7850bdf29bb0 and project 7170a1232ab14cd4aff705e91364d5c1. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:17:02.867528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:17:02.869865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:17:02.916614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29379d83-4c91-4a31-a273-a4ed3891ee14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818403 Sep 01 07:17:02.917286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 216/426] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:17:02.927862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1d33d8c2-022f-4004-bedb-7b2c1fe99791 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:02.928475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1d33d8c2-022f-4004-bedb-7b2c1fe99791 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:02.988932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d33d8c2-022f-4004-bedb-7b2c1fe99791 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:02.996478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1d33d8c2-022f-4004-bedb-7b2c1fe99791 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1219 microversion: 2.1 time: 0.072401 Sep 01 07:17:02.997044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 211/427] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:02 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:03.174134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:03.174755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:03.198901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:03.199420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:03.200304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:03.201272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:03.201906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:03.202521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:03.421063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:03.430951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7c2ded2-6ff7-4329-9fbf-073899ce178d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1371 microversion: 2.1 time: 0.260950 Sep 01 07:17:03.433501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 217/428] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:03.556260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:03.556994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:03.568487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:03.569524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:03.570541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:03.571816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:03.573154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:03.575883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:03.857307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:03.869247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:03.870965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:03.873007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-44d21100-e805-45cd-a31f-f11b7fc940fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1722 microversion: 2.20 time: 0.330150 Sep 01 07:17:03.873889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 212/429] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:04.019080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:04.020026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:04.029462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:04.030911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:04.031647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:04.033006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:04.033659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:04.034315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:04.114521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:04.126059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05d1fd2a-f4c6-47e0-8df8-f3f0f353f2a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1215 microversion: 2.1 time: 0.111213 Sep 01 07:17:04.127243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 218/430] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:04 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:04.452676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:04.453358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:04.460006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:04.460515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:04.460950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:04.461671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:04.462297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:04.462881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:04.606396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:04.616765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7558a3ee-a681-41f9-9b2b-5a0481a87770 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1566 microversion: 2.1 time: 0.167698 Sep 01 07:17:04.629331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 213/431] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:17:04.638353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:04.638944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:04.645100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:04.645677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:04.646111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:04.646788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:04.647231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:04.647674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:04.731268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff4227ca-a5eb-4710-8c0f-5696abd9ad76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096630 Sep 01 07:17:04.732321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 219/432] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 07:17:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:04.896707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:04.897632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:04.907614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:04.908719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:04.909551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:04.910516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:04.911005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:04.911433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:05.095599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:05.106541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:05.108990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:05.110441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b92f453-50ab-42f6-a60f-429e6d0108f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1722 microversion: 2.20 time: 0.218166 Sep 01 07:17:05.125146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 214/433] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:05.150980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:05.152317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:05.162176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:05.163190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:05.164130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:05.165060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:05.165674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:05.166159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:05.253090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:05.264491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-831ba99a-c467-4efe-8c0c-bdab36d52dda tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1215 microversion: 2.1 time: 0.119378 Sep 01 07:17:05.266476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 220/434] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:05 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:06.135874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:06.136476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:06.151414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:06.152038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:06.153041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:06.159759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:06.162545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:06.177418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:06.294688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:06.295274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:06.306001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:06.306491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:06.306925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:06.307616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:06.308058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:06.316765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:06.414610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:06.459502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:06.463195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:06.470266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5d7f0e6b-7efd-47cd-88de-db75c3a2d9a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1725 microversion: 2.20 time: 0.339216 Sep 01 07:17:06.474095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 215/435] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1725 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:06.483831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-6d0627a5-1829-44d7-b103-721d44903818 req-1b48c6c5-97c0-450a-8657-df7f19250b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179bc01d-7bec-423c-8b0f-170bfa0d6ab0", "name": "network-vif-unplugged", "status": "completed", "tag": "a391aacc-abe6-4876-aa12-6c9d9b026042"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:06.498416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6d0627a5-1829-44d7-b103-721d44903818 req-1b48c6c5-97c0-450a-8657-df7f19250b7c service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:06.499452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6d0627a5-1829-44d7-b103-721d44903818 req-1b48c6c5-97c0-450a-8657-df7f19250b7c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:06.500189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6d0627a5-1829-44d7-b103-721d44903818 req-1b48c6c5-97c0-450a-8657-df7f19250b7c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:06.512354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:06.529476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9cf4023c-c642-4ee3-9a49-b6232d9b523c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1271 microversion: 2.1 time: 0.238454 Sep 01 07:17:06.530888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 221/436] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:06 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:06.534387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6d0627a5-1829-44d7-b103-721d44903818 req-1b48c6c5-97c0-450a-8657-df7f19250b7c service nova] Creating event network-vif-unplugged:a391aacc-abe6-4876-aa12-6c9d9b026042 for instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 on hv-cinder-73306 Sep 01 07:17:06.541291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-2aa69ca6-b884-415e-b485-6b3da97848a4 req-2ba487db-0552-47f6-96ce-21a17307159f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56872759-8d04-492f-8020-a8143079785a", "tag": "4a7088df-c8f1-43bf-9d2a-48042b8faf52"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:06.549960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-6d0627a5-1829-44d7-b103-721d44903818 req-1b48c6c5-97c0-450a-8657-df7f19250b7c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074366 Sep 01 07:17:06.551076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 216/437] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:06.559711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2aa69ca6-b884-415e-b485-6b3da97848a4 req-2ba487db-0552-47f6-96ce-21a17307159f service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:06.561871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2aa69ca6-b884-415e-b485-6b3da97848a4 req-2ba487db-0552-47f6-96ce-21a17307159f service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:06.562889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77d9985b-2668-4f9a-b6ac-b183f7afcddd"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:06.563813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2aa69ca6-b884-415e-b485-6b3da97848a4 req-2ba487db-0552-47f6-96ce-21a17307159f service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:06.567263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:06.586853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:06.591803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:06.592548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:06.593544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:06.594759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:06.595160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-2aa69ca6-b884-415e-b485-6b3da97848a4 req-2ba487db-0552-47f6-96ce-21a17307159f service nova] Creating event network-changed:4a7088df-c8f1-43bf-9d2a-48042b8faf52 for instance 56872759-8d04-492f-8020-a8143079785a on hv-cinder-73306 Sep 01 07:17:06.596352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:06.605850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-2aa69ca6-b884-415e-b485-6b3da97848a4 req-2ba487db-0552-47f6-96ce-21a17307159f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073567 Sep 01 07:17:06.609222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 222/438] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:07.108039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f39df251-9c9f-4ca1-b5bb-320aab45f519 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "POST /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.554957 Sep 01 07:17:07.109592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 217/439] 10.222.0.46 () {62 vars in 1364 bytes} [Thu Sep 1 07:17:06 2022] POST /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 188 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:17:07.295652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:07.296539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:07.305440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:07.305920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:07.308649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:07.310215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:07.311047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:07.311776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:07.366023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120637) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 07:17:07.462357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ddf5718-8058-41c9-9a0d-5a945bf1cfc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "POST /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/action" status: 202 len: 0 microversion: 2.20 time: 0.176171 Sep 01 07:17:07.463785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 223/440] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Sep 1 07:17:07 2022] POST /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:17:07.472855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:07.473663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:07.493945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:07.494443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:07.495423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:07.495563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:07.498232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:07.498517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:07.555431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:07.556333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:07.597375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:07.598303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:07.598957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:07.600431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:07.602360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:07.603764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:07.830624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:07.849818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15836c90-64d9-45e4-8f94-8b5d9f788a59 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1277 microversion: 2.1 time: 0.298111 Sep 01 07:17:07.850753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 224/441] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:07 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1277 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:17:07.934387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:07.965032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:07.968387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:07.971269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9764a4e-8082-493c-a032-dcc97a90996c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1751 microversion: 2.20 time: 0.501662 Sep 01 07:17:07.973427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 218/442] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1751 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:08.874871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:08.875780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:08.888059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:08.888620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:08.889007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:08.889717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:08.890142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:08.890565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:08.996429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:08.998859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:09.006324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:09.008823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:09.009546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:09.010641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:09.011426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:09.012038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:09.603615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:09.615212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea349f6a-35cb-4649-95ad-063da7022b9e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.744068 Sep 01 07:17:09.624321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:09.634470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:09.636041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 225/443] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:08 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:09.639843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:09.641770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ec21f343-d909-45a9-8489-39bccc158180 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1751 microversion: 2.20 time: 0.651287 Sep 01 07:17:09.646221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 219/444] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1751 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:10.083507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:10.084810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:10.092522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:10.093005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:10.093492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:10.094191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:10.094641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:10.095062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:10.210109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-f7318ae9-2535-4a3a-91aa-588a44091987 req-3e3bfc50-0ee7-45bc-93a4-72fa53d5d87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1d3249-4d55-40bc-a993-ff010dccc5d5", "tag": "d6a13cfc-bdaf-444d-9009-5a670ed0abf6"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:10.230836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f7318ae9-2535-4a3a-91aa-588a44091987 req-3e3bfc50-0ee7-45bc-93a4-72fa53d5d87c service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:10.232613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f7318ae9-2535-4a3a-91aa-588a44091987 req-3e3bfc50-0ee7-45bc-93a4-72fa53d5d87c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:10.233322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f7318ae9-2535-4a3a-91aa-588a44091987 req-3e3bfc50-0ee7-45bc-93a4-72fa53d5d87c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:10.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-f7318ae9-2535-4a3a-91aa-588a44091987 req-3e3bfc50-0ee7-45bc-93a4-72fa53d5d87c service nova] Creating event network-changed:d6a13cfc-bdaf-444d-9009-5a670ed0abf6 for instance 9e1d3249-4d55-40bc-a993-ff010dccc5d5 on hv-cinder-73306 Sep 01 07:17:10.280642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-f7318ae9-2535-4a3a-91aa-588a44091987 req-3e3bfc50-0ee7-45bc-93a4-72fa53d5d87c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074880 Sep 01 07:17:10.281531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 220/445] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:17:10.448942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:10.453358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:10.466458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67999390-8825-4d73-a1d7-365e4db7c128 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1593 microversion: 2.1 time: 0.386358 Sep 01 07:17:10.467852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 226/446] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1593 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:10.640876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:10.641501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:10.650412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:10.651072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:10.651591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:10.652389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:10.653853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:10.664028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:10.668252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:10.668852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:10.669089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:10.675174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:10.675641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:10.676059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:10.690516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:10.691316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:10.692163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:11.078497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:11.090460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-251933ec-7140-484d-82cb-86b857c8b4f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.453846 Sep 01 07:17:11.091110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 221/447] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:10 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:17:11.093085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:11.103890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:11.105741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:11.107152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15824c5c-80fe-42fd-94a0-43ecbe03c317 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.442667 Sep 01 07:17:11.108217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 227/448] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:12.119055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:12.122398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:12.131385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:12.132024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:12.132620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:12.133150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:12.134453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:12.134970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:12.135464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:12.139655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:12.144008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:12.144813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:12.145521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:12.146442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:12.147104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:12.148015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:12.507763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:12.517638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:12.519309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:12.520711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c7f3440-baa6-43fc-a082-459c413dfed9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.393309 Sep 01 07:17:12.534264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 228/449] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:12.578078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:12.586242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f460d114-d9be-4a75-80d5-632549d24909 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.475495 Sep 01 07:17:12.591536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 222/450] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:12 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:12.863721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b9ffdb89-aae3-4393-a014-3b76c0624906 req-8bf29a20-8a49-4ac1-85b3-47cdb4ad6d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ac467b-0a5f-4e70-952c-3bead582e098", "tag": "af5f2bad-da1c-41a1-9b9f-c7eac9bc052a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:12.872064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:12.872994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:12.889579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b9ffdb89-aae3-4393-a014-3b76c0624906 req-8bf29a20-8a49-4ac1-85b3-47cdb4ad6d75 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:12.890496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b9ffdb89-aae3-4393-a014-3b76c0624906 req-8bf29a20-8a49-4ac1-85b3-47cdb4ad6d75 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:12.891420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b9ffdb89-aae3-4393-a014-3b76c0624906 req-8bf29a20-8a49-4ac1-85b3-47cdb4ad6d75 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:12.915337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b9ffdb89-aae3-4393-a014-3b76c0624906 req-8bf29a20-8a49-4ac1-85b3-47cdb4ad6d75 service nova] Creating event network-changed:af5f2bad-da1c-41a1-9b9f-c7eac9bc052a for instance e1ac467b-0a5f-4e70-952c-3bead582e098 on hv-cinder-73306 Sep 01 07:17:12.929844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b9ffdb89-aae3-4393-a014-3b76c0624906 req-8bf29a20-8a49-4ac1-85b3-47cdb4ad6d75 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069587 Sep 01 07:17:12.930687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 229/451] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:13.550402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:13.551931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:13.560263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:13.567024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:13.567918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:13.568647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:13.572811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:13.573619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:13.575156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:13.621304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:13.633064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:13.645286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:13.646294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:13.647087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:13.650447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:13.651161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:13.651941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:14.714590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:14.726564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f288ae1d-773b-4014-b7b8-185f5cc9aaca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 1.114248 Sep 01 07:17:14.727594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 230/452] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:13 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:17:14.788340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:14.809081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:14.810801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:14.812009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f9a2946-74bd-4b91-bd22-e57e602625eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 1.265937 Sep 01 07:17:14.812571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 223/453] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:15.290624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1245752128"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:15.291152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:15.297829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:15.298591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:15.299192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:15.300086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:15.300713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:15.301374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:15.747583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.network.security_group_api [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Adding security group 829adf0b-3799-431a-bba1-c0b0a7acd430 to port af5f2bad-da1c-41a1-9b9f-c7eac9bc052a Sep 01 07:17:15.751539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:15.760447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:15.769065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:15.772840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:15.774559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:15.775787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:15.777288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:15.778278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:16.190718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:16.238774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eeea8f86-9c81-4641-82dd-0093af18d602 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.492604 Sep 01 07:17:16.246904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 224/454] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:15 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:17:16.277860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:16.279029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:16.303288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:16.305398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:16.307428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:16.309834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:16.312062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:16.316079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:16.725416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c31e2740-1b96-4235-a60b-a31475dfab23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/action" status: 202 len: 0 microversion: 2.1 time: 1.438730 Sep 01 07:17:16.726233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 231/455] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:17:15 2022] POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/action => generated 0 bytes in 1441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:17:16.734841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f7e1b927-79c8-4f26-8f76-5b28ec6d023e req-3624053d-2615-414e-b08e-53c7a93197c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1d3249-4d55-40bc-a993-ff010dccc5d5", "name": "network-vif-plugged", "status": "completed", "tag": "d6a13cfc-bdaf-444d-9009-5a670ed0abf6"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:16.788259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f7e1b927-79c8-4f26-8f76-5b28ec6d023e req-3624053d-2615-414e-b08e-53c7a93197c6 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:16.788933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f7e1b927-79c8-4f26-8f76-5b28ec6d023e req-3624053d-2615-414e-b08e-53c7a93197c6 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:16.789156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f7e1b927-79c8-4f26-8f76-5b28ec6d023e req-3624053d-2615-414e-b08e-53c7a93197c6 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:16.822889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f7e1b927-79c8-4f26-8f76-5b28ec6d023e req-3624053d-2615-414e-b08e-53c7a93197c6 service nova] Creating event network-vif-plugged:d6a13cfc-bdaf-444d-9009-5a670ed0abf6 for instance 9e1d3249-4d55-40bc-a993-ff010dccc5d5 on hv-cinder-73306 Sep 01 07:17:16.842483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f7e1b927-79c8-4f26-8f76-5b28ec6d023e req-3624053d-2615-414e-b08e-53c7a93197c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111244 Sep 01 07:17:16.843676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 232/456] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:16.845498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:16.858984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:16.859657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:16.861915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:16.864092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:16.866007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0740f47-5087-4cc6-bc2c-248692fb5e4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.615092 Sep 01 07:17:16.867197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 225/457] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:16.872814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-3ffab500-c96e-4af2-8747-ddf19cde875f req-cd8997bf-b410-4373-ba55-e49af4c0f14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ac467b-0a5f-4e70-952c-3bead582e098", "tag": "af5f2bad-da1c-41a1-9b9f-c7eac9bc052a"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:16.885722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:16.886255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:16.886693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:16.887415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:16.887859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:16.888280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:16.892598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3ffab500-c96e-4af2-8747-ddf19cde875f req-cd8997bf-b410-4373-ba55-e49af4c0f14f service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:16.893719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3ffab500-c96e-4af2-8747-ddf19cde875f req-cd8997bf-b410-4373-ba55-e49af4c0f14f service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:16.894739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3ffab500-c96e-4af2-8747-ddf19cde875f req-cd8997bf-b410-4373-ba55-e49af4c0f14f service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:16.922356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-3ffab500-c96e-4af2-8747-ddf19cde875f req-cd8997bf-b410-4373-ba55-e49af4c0f14f service nova] Creating event network-changed:af5f2bad-da1c-41a1-9b9f-c7eac9bc052a for instance e1ac467b-0a5f-4e70-952c-3bead582e098 on hv-cinder-73306 Sep 01 07:17:16.934567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-3ffab500-c96e-4af2-8747-ddf19cde875f req-cd8997bf-b410-4373-ba55-e49af4c0f14f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063935 Sep 01 07:17:16.940519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 226/458] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:17.161914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:17.226403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b86f6233-b9cc-4999-8d45-47112b3ee62f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1758 microversion: 2.1 time: 0.381073 Sep 01 07:17:17.228234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 233/459] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1758 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:17.273925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:17.275059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:17.291836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:17.292555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:17.293361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:17.294530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:17.295254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:17.296663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:17.899340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:17.899954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:17.907174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:17.908224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:17.909892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:17.911043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:17.911944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:17.912936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:18.018036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:18.026282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1868cba3-49da-4c93-aed7-c871efaa6192 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.761438 Sep 01 07:17:18.045609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 227/460] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:17 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:18.211441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:18.231863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:18.234668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:18.236610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c5a1fc8-c64a-4d3e-a288-cb29776b0b38 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.342495 Sep 01 07:17:18.237201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 234/461] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:19.048032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:19.049475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:19.082389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:19.082389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:19.082389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:19.082389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:19.082738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:19.082738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:19.235918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:19.244468 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22dd88df-f0a5-46a6-bde0-e952d1d4a963 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.200420 Sep 01 07:17:19.245395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 228/462] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:19 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:19.264009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:19.265381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:19.281535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:19.282310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:19.282909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:19.283864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:19.284467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:19.285058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:19.465448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:19.476532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:19.478105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:19.479468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d744937-00fd-42e5-8855-deaea4019e28 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.222172 Sep 01 07:17:19.490572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 235/463] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:20.271304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:20.273162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:20.280107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:20.280896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:20.281419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:20.282202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:20.282725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:20.283214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:20.449363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:20.458004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e0151fc-3303-47ab-9e8c-5fb738cd2635 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.190505 Sep 01 07:17:20.458602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 229/464] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:20 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:20.503604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:20.504202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:20.511634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:20.512300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:20.512899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:20.513777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:20.514381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:20.514801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:20.651133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:20.660199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:20.661664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:20.662809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1a8e200a-11d0-4386-bcb9-ecbf34d22e06 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.163064 Sep 01 07:17:20.663403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 236/465] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:21.479455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:21.480061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:21.486624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:21.487355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:21.487792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:21.488501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:21.488957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:21.489420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:21.649387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:21.657784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2d785cd-f4d5-4d95-a2d7-5275bd0ed6e1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.182612 Sep 01 07:17:21.658735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 230/466] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:21 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:21.690339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:21.691300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:21.702966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:21.703438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:21.703858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:21.704749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:21.705219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:21.705632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:21.874164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:21.885615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:21.887554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:21.889094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55af94f9-a1a2-4497-96dd-442435ada718 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.203234 Sep 01 07:17:21.890426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 237/467] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:17:22.678685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:22.679963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:22.691536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:22.692144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:22.692659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:22.693482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:22.693971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:22.694430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:22.840682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:22.849214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dd5045f6-a5be-4809-9dcd-24f013c77eea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.174355 Sep 01 07:17:22.857386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 231/468] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:22 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:22.912090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:22.912848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:22.920098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:22.920711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:22.921271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:22.922023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:22.922679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:22.923161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:23.147210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:23.156201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:23.157653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:23.158789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34509260-956a-4684-928e-ecefa0a458db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.250909 Sep 01 07:17:23.159334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 238/469] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:23.869891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:23.870482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:23.880266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:23.880794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:23.881324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:23.882083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:23.882689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:23.883113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:24.099858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:24.107493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9388c8ac-0241-45bc-99bf-36cf702a81d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.241417 Sep 01 07:17:24.107984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 232/470] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:23 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:24.182494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:24.183112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:24.201477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:24.202363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:24.203208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:24.204154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:24.204813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:24.205607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:24.377935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:24.403024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:24.404472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:24.405692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c6a229b-ab1a-44aa-b881-32bc44b34ddb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.227269 Sep 01 07:17:24.419044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 239/471] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:25.127930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:25.128544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:25.135235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:25.135733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:25.136178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:25.136879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:25.137382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:25.137814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:25.320177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:25.329556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8dcfc47-5634-465e-9e36-ea6105e87029 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.205387 Sep 01 07:17:25.330138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 233/472] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:25 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:25.428435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:25.429037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:25.435523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:25.435995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:25.436419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:25.437332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:25.437775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:25.438370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:25.652824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:25.661398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:25.662848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:25.664047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f02db764-924e-455b-a6f1-725a00ef5504 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.239798 Sep 01 07:17:25.664600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 240/473] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:26.351670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:26.352458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:26.358747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:26.359266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:26.359752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:26.360480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:26.360958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:26.361446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:26.506402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:26.514894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f551588-b227-47a9-b54b-18e499282c84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.167486 Sep 01 07:17:26.515397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 234/474] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:26 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:26.686487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:26.687084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:26.704982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:26.705709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:26.711498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:26.712305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:26.712889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:26.713410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:26.878903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:26.890201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:26.892249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:26.893778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c13ff91-b2ee-4579-a07f-d85eb600f121 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.211107 Sep 01 07:17:26.894402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 241/475] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:27.535941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:27.536549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:27.542560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:27.543039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:27.543490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:27.544151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:27.544602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:27.545196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:27.671937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:27.680012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b28d6af9-cb6b-430d-a378-3a8da00726cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.147476 Sep 01 07:17:27.680587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 235/476] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:27 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:27.916858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:27.917491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:27.923877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:27.924352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:27.924783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:27.925499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:27.925945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:27.926361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:28.058481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:28.066864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:28.068298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:28.069477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da0c556d-6b1b-4f18-87de-6cb0febae90c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.156470 Sep 01 07:17:28.070022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 242/477] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:28.700795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:28.701441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:28.703819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=66 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:28.708976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:28.709498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:28.709937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:28.710636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:28.711094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:28.711523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:28.904540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:28.912436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-92032cb2-25ae-4235-b049-91a06258d795 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1319 microversion: 2.1 time: 0.216045 Sep 01 07:17:28.913008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 236/478] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:28 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:29.091512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:29.092143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:29.098514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:29.098990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:29.099411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:29.100088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:29.100536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:29.100942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:29.229991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:29.238550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:29.240063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:29.241326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6fc72824-4e3d-4594-8c0f-673b49bd6653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.153646 Sep 01 07:17:29.241968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 243/479] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:29.933617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:29.934155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:29.940703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:29.941466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:29.941975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:29.942853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:29.943308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:29.943803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:30.072744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:30.080387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5d50cae5-87d9-4494-b7d9-0452459bda55 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1508 microversion: 2.1 time: 0.150696 Sep 01 07:17:30.080942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 237/480] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:29 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:30.264600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:30.265331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:30.271933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:30.272416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:30.272850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:30.273571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:30.274021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:30.274442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:30.419029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:30.428771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:30.430284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:30.431438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89c42a3c-079d-4192-bf88-7dc0ae13d881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.170766 Sep 01 07:17:30.432533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 244/481] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:31.454231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:31.454842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:31.461223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:31.461710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:31.462150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:31.463488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:31.463970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:31.464379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:31.481830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:31.596506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:31.605247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:31.606716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:31.607864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7ba695cd-01e6-42df-851a-01599e7b6830 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.157596 Sep 01 07:17:31.608413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 238/482] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:32.633291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:32.634206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:32.636767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:32.641885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:32.642364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:32.642799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:32.643478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:32.643925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:32.644344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:32.648924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:32.776763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:32.786561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:32.788031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:32.789231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c73bb55-c26c-42d8-8bf7-e374848bb156 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.160002 Sep 01 07:17:32.789794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 245/483] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:33.812309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:33.812906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:33.819189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:33.819671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:33.820112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:33.820795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:33.821263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:33.821686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:33.955021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:33.963691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:33.965707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:33.967034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b62d614c-3b89-4c9c-9762-460b7b76e3c4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.159158 Sep 01 07:17:33.967593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 239/484] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:34.990180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:34.990782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:34.997542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:34.998019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:34.998445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:34.999124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:34.999569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:34.999985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:35.138617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:35.147205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:35.148724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:35.149905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7b2217d-e13d-491d-a811-3bb1b33cf306 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.163554 Sep 01 07:17:35.150462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 246/485] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:36.173559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:36.174186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:36.181287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:36.181763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:36.182197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:36.182875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:36.183322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:36.183738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:36.314213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:36.323101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:36.325355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:36.326538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c66d7de8-539c-419d-aa3d-42672a11c332 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.156973 Sep 01 07:17:36.327091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 240/486] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:37.349751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:37.350822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:37.357898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:37.358367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:37.358790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:37.359459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:37.359896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:37.360306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:37.487140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:37.495491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:37.496958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:37.498134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02455096-f21e-4a1d-9fec-0ebc7e9384ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.152273 Sep 01 07:17:37.498683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 247/487] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:38.525346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:38.528205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:38.534762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:38.535342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:38.535791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:38.536492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:38.536948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:38.537586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:38.910706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:38.921641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:38.923149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:38.924259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f6e4097-973f-4da9-b2cf-7bf6ce95d32d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.407139 Sep 01 07:17:38.925171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 241/488] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:39.951201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:39.952881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:39.960204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:39.960971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:39.961510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:39.962224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:39.962673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:39.963099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:40.113523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:40.122613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:40.124136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:40.125333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8204cab-6b88-4129-8221-32539b9af74e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.181337 Sep 01 07:17:40.126108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 248/489] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:40.473706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-cc1121d1-9ac4-4c49-9895-5d831315ac4f req-367bfbba-8e46-4370-af96-3962c874fa3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179bc01d-7bec-423c-8b0f-170bfa0d6ab0", "name": "network-vif-plugged", "status": "completed", "tag": "a391aacc-abe6-4876-aa12-6c9d9b026042"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:40.485403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cc1121d1-9ac4-4c49-9895-5d831315ac4f req-367bfbba-8e46-4370-af96-3962c874fa3d service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:40.486338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cc1121d1-9ac4-4c49-9895-5d831315ac4f req-367bfbba-8e46-4370-af96-3962c874fa3d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:40.486980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cc1121d1-9ac4-4c49-9895-5d831315ac4f req-367bfbba-8e46-4370-af96-3962c874fa3d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:40.500052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-cc1121d1-9ac4-4c49-9895-5d831315ac4f req-367bfbba-8e46-4370-af96-3962c874fa3d service nova] Creating event network-vif-plugged:a391aacc-abe6-4876-aa12-6c9d9b026042 for instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 on hv-cinder-73306 Sep 01 07:17:40.505440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-cc1121d1-9ac4-4c49-9895-5d831315ac4f req-367bfbba-8e46-4370-af96-3962c874fa3d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035671 Sep 01 07:17:40.506162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 242/490] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:41.149433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:41.149976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:41.156892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:41.157401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:41.157832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:41.158512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:41.158957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:41.159372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:41.306385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:41.315325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:41.316756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:41.317960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0aa20e4-ad9c-45ee-972f-787dc5cdc6cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.172643 Sep 01 07:17:41.318484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 249/491] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:42.343649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:42.344334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:42.350378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:42.350853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:42.351282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:42.351960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:42.352406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:42.352824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:42.485048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:42.494829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:42.496269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:42.497494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a3d6b3e-c9e2-4d43-a807-41cb2e78e8b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.159127 Sep 01 07:17:42.498058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 243/492] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:43.521397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:43.522497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:43.529417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:43.529809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:43.530239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:43.530911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:43.531356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:43.531766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:43.668031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:43.677280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:43.678838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:43.679999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88fa1338-3cbd-4f45-a48d-aa4c1d12164a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1809 microversion: 2.20 time: 0.162480 Sep 01 07:17:43.680581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 250/493] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:17:44.702326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:44.702925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:44.709824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:44.710308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:44.710741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:44.711426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:44.711878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:44.712295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:44.840452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:44.848889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:44.850355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:44.851499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8863cac7-385d-47ef-9ac3-50daf7134c0e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1796 microversion: 2.20 time: 0.153082 Sep 01 07:17:44.852057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 244/494] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:17:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1796 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:17:47.479913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:47.482311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:47.488769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:47.489277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:47.489704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:47.490383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:47.490828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:47.491244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:47.561168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19ba284c-0f08-49eb-86e7-b4781010188d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/action" status: 202 len: 0 microversion: 2.1 time: 0.084960 Sep 01 07:17:47.564183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 251/495] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:17:47 2022] POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:17:47.571109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:47.571739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:47.579033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:47.579604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:47.580130 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:47.580825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:47.581390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:47.581806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:47.766062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:47.774378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-52cdd2ed-9669-45c3-8466-135ea6039df0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1750 microversion: 2.1 time: 0.208031 Sep 01 07:17:47.774955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 245/496] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1750 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:48.477146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c7d4fdd-b59d-4ae0-af1d-1833119cdd69", "device": "/dev/sdb"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:48.480072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:48.486625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:48.487101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:48.487532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:48.488211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:48.488657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:48.489075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:48.760077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-95abef6e-dc0e-441b-8403-473eb654029e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "POST /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287041 Sep 01 07:17:48.766511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 252/497] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:17:48 2022] POST /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:48.795569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:48.796189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:48.803035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:48.803524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:48.803964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:48.804661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:48.805133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:48.805562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:48.955262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:48.963375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a58ddab-7db7-4e23-8255-73bf1c90a26e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.171683 Sep 01 07:17:48.963939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 246/498] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:49.985185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:49.985876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:49.991942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:49.992416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:49.992844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:49.993550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:49.993994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:49.994411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:50.132178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:50.140466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8d2fbca1-0756-4bfc-bb6d-5d5937a6a958 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.160445 Sep 01 07:17:50.141026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 253/499] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:51.161226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:51.161835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:51.168168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:51.168643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:51.169075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:51.169776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:51.170220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:51.170635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:51.311491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:51.319518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7ebff1ba-94a6-42bc-bfbf-65e29027d4ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.162206 Sep 01 07:17:51.320075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 247/500] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:52.341177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:52.341788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:52.348328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:52.348799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:52.349263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:52.349940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:52.350381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:52.350795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:52.493916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:52.501823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24bed6c3-a073-4ae5-89b7-611cf46f2561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.164545 Sep 01 07:17:52.502369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 254/501] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:53.522718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:53.523329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:53.530295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:53.530783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:53.531222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:53.531917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:53.532369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:53.532795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:53.672581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:53.680750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bcca95ae-6b56-4ee9-ae60-abbad07aac01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.161882 Sep 01 07:17:53.681341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 248/502] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:54.421882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f3997af-a23f-40cb-b325-85a64d3e1aa7"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:17:54.424277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:54.430600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:54.431103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:54.431530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:54.432207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:54.432654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:54.433071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:54.702499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:54.703117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:54.709852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:54.710338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:54.710776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:54.711464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:54.711917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:54.712342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:54.714019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3418bdc9-7709-4ef3-a6ac-a35ab1f17d07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296461 Sep 01 07:17:54.714991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 255/503] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:17:54 2022] POST /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:17:54.861272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:54.869298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b506004-0c35-40ac-898e-dc9f38dbff88 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.171355 Sep 01 07:17:54.869854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 249/504] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:55.890828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:55.891514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:55.897600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:55.898068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:55.898491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:55.899210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:55.899646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:55.900102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:56.040297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:56.048637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-45d4193f-c3e5-437c-9432-0ab00c4a4be3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.162902 Sep 01 07:17:56.049214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 256/505] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:57.069364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:57.069973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:57.076003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:57.076489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:57.076926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:57.077643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:57.078097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:57.078522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:57.226007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:57.234694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f14b17d-d921-4c53-ab92-e949b7b6e974 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.169176 Sep 01 07:17:57.235253 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 250/506] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:58.255683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:58.256321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:58.263297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:58.263799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:58.264227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:58.264906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:58.265379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:58.265796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:58.405998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:58.414120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0f2382c-fa4f-4d79-a0ee-6abd66d6fa49 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.162364 Sep 01 07:17:58.414671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 257/507] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:17:59.436928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:17:59.437633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:17:59.440077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:17:59.445898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:59.446374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:59.446805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:59.447482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:17:59.447929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:17:59.448344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:17:59.587996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:17:59.596340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f8e69ef-9f67-43d6-835f-1023edd29a59 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.163739 Sep 01 07:17:59.596913 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 251/508] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:17:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:00.617841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:00.618375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:00.624747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:00.625263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:00.625699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:00.626371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:00.626817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:00.627234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:00.631198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:00.772364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:00.780561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-121b7a98-5d0f-49de-9d65-e84ed2d69808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.166634 Sep 01 07:18:00.781148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 258/509] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:01.801558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:01.802201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:01.808636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:01.809141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:01.809580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:01.810276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:01.810728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:01.811152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:01.813674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=77 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:01.948882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:01.957704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e331bb77-911a-4f9b-916b-f2ac8e57cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.160024 Sep 01 07:18:01.958386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 252/510] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:02.979524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:02.980152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:02.983093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:02.988375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:02.988859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:02.989329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:02.990053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:02.990501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:02.990924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:03.146751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:03.155900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47feeda4-e0ab-4f6e-821b-5a07047aba1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.180210 Sep 01 07:18:03.156465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 259/511] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:04.176648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:04.177307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:04.183576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:04.184049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:04.184476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:04.185863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:04.186316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:04.187113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:04.326478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:04.335412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2cefc343-abee-4596-8c52-fd4968409562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.162574 Sep 01 07:18:04.335976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 253/512] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:04 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:05.355571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:05.356173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:05.362500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:05.362968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:05.363394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:05.364068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:05.364506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:05.364914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:05.504622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:05.512936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0aa9cf8c-57f8-4c1e-b0ed-79430854c881 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.161146 Sep 01 07:18:05.514087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 260/513] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:06.540001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:06.540606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:06.547060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:06.547534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:06.547964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:06.548642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:06.549090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:06.549532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:06.688125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:06.696188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1549e68d-711c-4886-bef7-cf8a69a65bf9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.160089 Sep 01 07:18:06.696746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 254/514] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:07.717462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:07.718040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:07.724320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:07.724815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:07.725265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:07.725935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:07.726372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:07.726781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:07.864329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:07.872341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d7a3270-cbca-49b1-b5a5-19bfc1994406 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.158821 Sep 01 07:18:07.873564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 261/515] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:08.894208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:08.894809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:08.901065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:08.901573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:08.902006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:08.902686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:08.903134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:08.903554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:09.049238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:09.057374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-888a06ff-fb0a-4cd6-9aba-5d16d2a0fe0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.166942 Sep 01 07:18:09.058024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 255/516] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:10.079163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:10.079765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:10.086178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:10.086647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:10.087071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:10.087740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:10.088176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:10.088589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:10.225643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:10.233784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d03f6e3-4484-4880-9b2b-caedb4e6148b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.159132 Sep 01 07:18:10.234340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 262/517] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:11.253736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:11.254354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:11.260882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:11.261392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:11.261824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:11.262501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:11.262948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:11.263400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:11.403310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:11.411914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-647b8b82-ead6-4082-a5f7-7d1824d92ae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.162108 Sep 01 07:18:11.412476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 256/518] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:12.433191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:12.433790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:12.440717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:12.441549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:12.441996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:12.442665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:12.443103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:12.443515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:12.582374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:12.590409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c5d2b544-f31e-49d1-a92e-b8f57bf0f980 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.161113 Sep 01 07:18:12.590962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 263/519] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:13.610766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:13.611377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:13.617723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:13.618206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:13.618641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:13.619330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:13.619779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:13.620201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:13.761556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:13.770619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f9df7e00-54da-4500-b8ff-ea6ebe1648d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.163678 Sep 01 07:18:13.771185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 257/520] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:14.790917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:14.791610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:14.798096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:14.798569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:14.799002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:14.799689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:14.800118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:14.800525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:14.946568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:14.955422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5012fda-db10-4221-9c7c-9159478dbf43 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.168353 Sep 01 07:18:14.955968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 264/521] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:15.975746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:15.976351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:15.983348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:15.983857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:15.984290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:15.984975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:15.985449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:15.985869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:16.122050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:16.130148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-990c2e3e-5ffb-4351-badf-e84a524dc46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.158252 Sep 01 07:18:16.130703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 258/522] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:17.150893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:17.151491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:17.158588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:17.159063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:17.159488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:17.160155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:17.160594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:17.161004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:17.307268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:17.315407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad741e1b-4ef3-4f99-9fc2-03f167dbdcfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.168273 Sep 01 07:18:17.315963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 265/523] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:18.336644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:18.337187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:18.343681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:18.344203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:18.344642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:18.345378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:18.345838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:18.346267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:18.484760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:18.493092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d8f897b0-5abb-4b6a-81aa-5fba45df2c8f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.160431 Sep 01 07:18:18.493673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 259/524] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:19.515090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:19.515668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:19.522615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:19.523093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:19.523519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:19.524195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:19.524635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:19.525073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:19.666421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:19.674413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e97a22b3-bf10-4bd4-b948-57dec34ee3b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.163209 Sep 01 07:18:19.674971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 266/525] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:20.695646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:20.696257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:20.703142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:20.703630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:20.704074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:20.704765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:20.705251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:20.705685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:20.844228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:20.852301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5cf6b146-c8ce-4cf5-a899-cd570c67457f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.160488 Sep 01 07:18:20.852873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 260/526] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:21.872898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:21.873528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:21.880023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:21.880492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:21.880913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:21.881617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:21.882052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:21.882459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:22.020818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:22.028783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42204375-a4dc-462f-acf0-92bf456a6c8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.159667 Sep 01 07:18:22.029365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 267/527] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:23.050352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:23.050957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:23.057399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:23.057876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:23.058303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:23.058979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:23.059423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:23.059841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:23.202318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:23.210421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0ca99f59-588f-41a1-9908-9999f64e6218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.164454 Sep 01 07:18:23.210981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 261/528] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:18:24.231426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:24.232024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:24.238871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:24.239346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:24.239767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:24.240450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:24.240890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:24.241335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:24.383851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:24.392220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0ca5257-ab20-4ac8-9031-a9ff53e6acfa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.164536 Sep 01 07:18:24.392778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 268/529] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:24 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:25.412834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:25.413478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:25.419870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:25.420349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:25.420783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:25.421504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:25.421952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:25.422375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:25.561436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:25.570127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0fde266-060e-44e9-aa3d-0fdb6000b7c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.161131 Sep 01 07:18:25.570690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 262/530] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:26.227946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:26.228521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:26.234658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:26.235134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:26.235562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:26.236254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:26.236695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:26.237131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:26.268945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c0b2922-1546-4ae0-9165-8bbdd07ee40f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments/77d9985b-2668-4f9a-b6ac-b183f7afcddd" status: 200 len: 194 microversion: 2.20 time: 0.044957 Sep 01 07:18:26.269548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 269/531] 10.222.0.46 () {60 vars in 1454 bytes} [Thu Sep 1 07:18:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments/77d9985b-2668-4f9a-b6ac-b183f7afcddd => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:26.333733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:26.334219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:26.340032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:26.340510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:26.340938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:26.341652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:26.342099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:26.342517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:26.466574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lazy-loading 'services' on Instance uuid 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:18:26.580808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6cdf5820-52b2-41f0-8641-4c5a431793fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "DELETE /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments/77d9985b-2668-4f9a-b6ac-b183f7afcddd" status: 202 len: 0 microversion: 2.20 time: 0.250772 Sep 01 07:18:26.581431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 263/532] 10.222.0.46 () {60 vars in 1457 bytes} [Thu Sep 1 07:18:26 2022] DELETE /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments/77d9985b-2668-4f9a-b6ac-b183f7afcddd => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:18:26.589738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:26.591734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:26.591969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:26.592422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:26.598095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:26.598573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:26.599006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:26.599693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:26.600136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:26.600551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:26.600652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:26.601648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:26.602213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:26.602922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:26.603379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:26.603851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:26.631070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-57e53384-248f-4fb9-9c9e-e29409541796 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045228 Sep 01 07:18:26.631624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 270/533] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:26.745271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:26.754010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-27123ff4-00d7-47e1-bc84-2be71f7d2c82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.166271 Sep 01 07:18:26.754591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 264/534] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:18:27.643582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:27.645821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:27.652126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:27.652596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:27.653024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:27.653722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:27.654164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:27.654581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:27.682712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f375e7b0-42c0-46d4-9160-43bf6ae4ec9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043744 Sep 01 07:18:27.683255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 271/535] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:27.774891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:27.775498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:27.781750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:27.782237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:27.782669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:27.783354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:27.783801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:27.784230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:27.921131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:27.929246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2fd9a737-01f1-4a05-8a8b-af9706431449 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.158129 Sep 01 07:18:27.929803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 265/536] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:28.694918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:28.697068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:28.703367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:28.704335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:28.704760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:28.705457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:28.705902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:28.706315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:28.735211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f374c093-2aeb-41ff-8f90-db56f681ce4b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044240 Sep 01 07:18:28.735751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 272/537] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:28.950971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:28.951541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:28.958480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:28.958961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:28.959396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:28.960080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:28.960532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:28.960952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:29.101920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:29.109938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a4fd242-ac8f-4bf0-83c1-15d9d09ff1e8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.162927 Sep 01 07:18:29.110495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 266/538] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:29.747427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:29.749573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:29.755879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:29.756348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:29.756773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:29.757474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:29.757920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:29.758335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:29.788411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b28cc9b6-4efc-4290-a173-5944dd405772 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045023 Sep 01 07:18:29.788958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 273/539] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:30.129850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:30.130461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:30.132850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=32 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:30.139078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:30.139559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:30.139991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:30.140680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:30.141160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:30.141587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:30.280656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:30.289479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0ed1f502-935a-4c49-9fd8-f6b3ca299561 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.163428 Sep 01 07:18:30.290038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 267/540] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:30.803059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:30.805216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:30.811664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:30.812139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:30.812565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:30.813790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:30.814232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:30.814642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:30.817054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=95 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:30.845302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1eb3724-1fd5-4dfc-b0f6-d4e8904230be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049090 Sep 01 07:18:30.845840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 274/541] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:31.310259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:31.310869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:31.317771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:31.318257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:31.318698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:31.319387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:31.319840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:31.320262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:31.324112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:31.468276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:31.476860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d50b562-bd1e-4f92-9861-d21b4b2798d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.170449 Sep 01 07:18:31.477458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 268/542] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:31.858612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:31.860740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:31.866589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:31.867063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:31.867487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:31.868158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:31.868593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:31.869003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:31.897493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e249656-ca86-465f-809e-5285471b0120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043017 Sep 01 07:18:31.898025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 275/543] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:18:32.497601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:32.498205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:32.505024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:32.505526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:32.505958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:32.506631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:32.507100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:32.507514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:32.649675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:32.657761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8c290fcc-7645-44a3-a1f6-a4b45611c05b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.163992 Sep 01 07:18:32.658317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 269/544] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:32.910570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:32.912639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:32.919169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:32.919635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:32.920059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:32.920728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:32.921195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:32.921613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:32.951619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4aba3cba-4495-442e-85b1-9c6968529c55 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045836 Sep 01 07:18:32.952158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 276/545] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:33.678588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:33.679126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:33.685336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:33.685812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:33.686243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:33.686926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:33.687368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:33.687783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:33.836677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:33.844906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c346016-b0c4-49e7-b00b-c33d7a295434 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.170281 Sep 01 07:18:33.845497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 270/546] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:33.963972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:33.966018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:33.968355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=36 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:33.973741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:33.974207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:33.974635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:33.975296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:33.975733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:33.976143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:34.005638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c956b0d5-f6fd-40b0-a62b-a9500c40ca6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045407 Sep 01 07:18:34.006176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 277/547] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:34.865366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:34.865975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:34.872181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:34.872668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:34.873099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:34.873806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:34.874256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:34.874676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:35.013394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:35.018659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:35.020676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:35.022001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-111082e2-e9bd-4c01-a50a-03beac28703f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.160443 Sep 01 07:18:35.022568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 271/548] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:35.027025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:35.027491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:35.027912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:35.028586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:35.029027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:35.029462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:35.058663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de5301a6-f867-420e-aaac-5acde4f57b05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044486 Sep 01 07:18:35.059199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 278/549] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:18:36.043280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:36.043893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:36.050839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:36.051322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:36.051759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:36.052447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:36.052905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:36.053361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:36.070852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:36.073049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:36.079286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:36.079753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:36.080176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:36.080850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:36.081322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:36.081744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:36.111746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21667532-d581-43f1-9686-5f2a7efa8006 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044777 Sep 01 07:18:36.112303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 279/550] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:18:36.190564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:36.198625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7942350-d502-4c41-ab33-edd64c679c05 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.159180 Sep 01 07:18:36.199186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 272/551] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:37.123818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:37.126626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:37.132858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:37.133359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:37.133783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:37.134446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:37.135137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:37.135551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:37.164294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0022a31e-1944-49d8-b717-6c578ea0fa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044339 Sep 01 07:18:37.164827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 280/552] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:37.219556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:37.220166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:37.226645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:37.227134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:37.227601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:37.228328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:37.228788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:37.229246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:37.372910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:37.381223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca9289ce-e42b-4b41-8e36-0e664ef2bf0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.165376 Sep 01 07:18:37.381736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 273/553] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:38.176770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:38.178913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:38.185166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:38.185780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:38.186189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:38.186860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:38.187296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:38.187705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:38.215987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be0aed9b-410d-49dc-bdfd-2813b093d458 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043567 Sep 01 07:18:38.216519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 281/554] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:38.402665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:38.403231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:38.410026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:38.410504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:38.410931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:38.411612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:38.412056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:38.412472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:38.550208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:38.558686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a35c84dc-872d-4b87-824b-bdd5f1c1e5e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.159880 Sep 01 07:18:38.559963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 274/555] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:39.228740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:39.230855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:39.237692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:39.238168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:39.238592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:39.239261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:39.239697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:39.240109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:39.269760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8466fbb-770c-4ba3-8781-8ed0102a4507 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045005 Sep 01 07:18:39.270290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 282/556] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:39.579799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:39.580409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:39.586796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:39.587254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:39.588053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:39.588353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:39.588806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:39.589268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:39.728804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:39.737420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59036510-80e3-4333-8059-63d7737e558f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.161473 Sep 01 07:18:39.737988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 275/557] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:40.281959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:40.284076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:40.290522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:40.290994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:40.291424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:40.292098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:40.292538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:40.292951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:40.323026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c672a10c-748c-431e-bab9-40d95a705468 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044966 Sep 01 07:18:40.323584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 283/558] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:40.759317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:40.760581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:40.769243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:40.769357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:40.769765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:40.770488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:40.771143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:40.771563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:40.909743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:40.917788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7930b660-9bbc-4635-a2b8-91337e8d7171 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.163447 Sep 01 07:18:40.918344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 276/559] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:41.336555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:41.340143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:41.348859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:41.349374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:41.349800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:41.350473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:41.350911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:41.351320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:41.380046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02f60329-a7e1-426e-839a-6b446fdfdae1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047977 Sep 01 07:18:41.380594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 284/560] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:41.939157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:41.939667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:41.946037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:41.946520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:41.946986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:41.947676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:41.948126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:41.948546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:42.086197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:42.094921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2853c13e-c195-4068-bbf1-ce4e9f8ccd21 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.159212 Sep 01 07:18:42.095467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 277/561] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:42.392834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:42.395069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:42.401507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:42.401973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:42.402400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:42.403070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:42.403506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:42.403915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:42.433124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c726bc1-fc3b-43ec-8193-4256246e4c29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044827 Sep 01 07:18:42.433682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 285/562] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:43.116522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:43.117175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:43.123491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:43.123973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:43.124408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:43.125093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:43.126131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:43.126561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:43.268985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:43.277125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-abcbbdd6-b0c9-4595-b37d-6d47597eefbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.164413 Sep 01 07:18:43.277735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 278/563] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:43.445357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:43.447393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:43.453783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:43.454254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:43.454681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:43.455354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:43.455795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:43.456209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:43.485583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e39523bf-b179-4066-b4a7-466ceed5ba5b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043607 Sep 01 07:18:43.486121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 286/564] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:44.297912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:44.298558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:44.305312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:44.305796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:44.306233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:44.306920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:44.307373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:44.307798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:44.449037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:44.457777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc59e189-2fde-4fc1-bb15-a2df504b02c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.163678 Sep 01 07:18:44.458336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 279/565] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:44.497241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:44.499675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:44.506737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:44.507234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:44.507668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:44.508349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:44.508793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:44.509242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:44.537626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39b0bc17-c76f-4c2a-85ca-59761707cac5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 Sep 01 07:18:44.538170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 287/566] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:45.478361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:45.478970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:45.485349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:45.485829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:45.486262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:45.486939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:45.487383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:45.487797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:45.549733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:45.551971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:45.558249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:45.558714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:45.559134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:45.559808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:45.560247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:45.560662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:45.590291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d2cb998-de69-41bf-80cf-1e32d9e076e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044491 Sep 01 07:18:45.590849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 288/567] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:18:45.629693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:45.638078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0bb63e57-9e3a-417a-8f9d-9ac392dc206b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.163488 Sep 01 07:18:45.638642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 280/568] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:46.602902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:46.605007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:46.611568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:46.612044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:46.612471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:46.613169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:46.613614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:46.614029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:46.643561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66d6c9fc-66fd-462f-9ace-8e38cfd29378 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044582 Sep 01 07:18:46.644092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 289/569] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:46.659210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:46.659818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:46.666214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:46.666690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:46.667120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:46.667796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:46.668244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:46.668657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:46.807225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:46.816020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-593da091-1477-41e3-921f-9fded62a981b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.160581 Sep 01 07:18:46.816570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 281/570] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:47.655897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:47.658629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:47.664967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:47.665459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:47.665883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:47.666557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:47.667001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:47.667414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:47.691274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:47.696518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3568025-5e82-441b-b3d9-39db429abedd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044657 Sep 01 07:18:47.697057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 290/571] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:47.836878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:47.837510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:47.843963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:47.844443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:47.844876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:47.845594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:47.846041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:47.846459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:47.986598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:47.994653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be587507-5db3-46dd-a4a8-91ff9724951f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.161557 Sep 01 07:18:47.995309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 282/572] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:48.709430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:48.712421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:48.718742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:48.719213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:48.719643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:48.720354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:48.720796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:48.721239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:48.749462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b0de2fd-189e-4324-9b2f-2f8adfbcc074 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044747 Sep 01 07:18:48.749941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 291/573] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:49.015852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:49.016394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:49.022699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:49.023172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:49.023601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:49.024279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:49.024734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:49.025156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:49.160315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:49.168370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dc40aff6-b824-40b6-8015-3663d2121df6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.156338 Sep 01 07:18:49.168924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 283/574] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:49.763416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:49.765650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:49.772446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:49.772919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:49.773376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:49.774060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:49.774499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:49.774913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:49.804466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc12557d-e82b-463e-8a58-c0fe197ff095 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045321 Sep 01 07:18:49.805022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 292/575] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:50.190194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:50.190832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:50.197228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:50.197709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:50.198143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:50.198825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:50.199278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:50.199707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:50.337884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:50.340083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:18:50.347276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3e0ab65f-fdfe-4615-bc6f-18f9d309ae7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.161468 Sep 01 07:18:50.347870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 284/576] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:50.816912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:50.819010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:50.825272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:50.825743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:50.826167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:50.826888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:50.827325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:50.827734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:50.856228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b53b6e8-660f-43a0-91d8-cfa9adf9f9f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043891 Sep 01 07:18:50.856752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 293/577] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:51.368212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:51.368856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:51.375234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:51.375719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:51.376158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:51.376902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:51.377725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:51.378479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:51.522933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:51.530997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93101232-38c9-42c0-bbb1-0de1f68197a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.166628 Sep 01 07:18:51.531557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 285/578] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:51.868439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:51.870592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:51.877376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:51.877852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:51.878283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:51.878962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:51.879414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:51.879835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:51.909558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e7eb355-a009-475f-9eec-a2f8ffe1be48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045064 Sep 01 07:18:51.910100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 294/579] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:52.552933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:52.553586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:52.559923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:52.560403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:52.560837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:52.561554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:52.562005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:52.562427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:52.698982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:52.707543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07f26d69-5960-4ff4-90fa-aef66266cd95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.159196 Sep 01 07:18:52.708106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 286/580] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:52.921778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:52.924166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:52.930584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:52.931053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:52.931480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:52.932151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:52.932592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:52.933005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:52.962848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91051287-a0f1-445c-865f-e1f93ae79a19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044910 Sep 01 07:18:52.963332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 295/581] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:53.728842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:53.729488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:53.735741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:53.736722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:53.737182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:53.737890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:53.738326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:53.738747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:53.887891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:53.896321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a4e221d-3be1-4595-b4a9-5dfe023f9f06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1755 microversion: 2.1 time: 0.171218 Sep 01 07:18:53.896813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 287/582] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:53.975299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:53.977522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:53.984560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:53.984935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:53.985598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:53.987336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:53.988265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:53.988839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:54.018625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8dbf6b1-43a6-4d47-966f-f5c2caa3767c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047927 Sep 01 07:18:54.019176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 296/583] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:54.916908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:54.917579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:54.924259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:54.924964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:54.925429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:54.926116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:54.926563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:54.926979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:55.030614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:55.033666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:55.040305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:55.040789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:55.041385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:55.042082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:55.042533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:55.042952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:55.073402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e734d94c-a9e6-467e-a3fc-34cb3347f4ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046580 Sep 01 07:18:55.073972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 297/584] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:18:55.077926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:55.082165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:18:55.084435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:55.086200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53aad7a5-1ca9-42bc-ad32-f66379115f12 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1758 microversion: 2.1 time: 0.173099 Sep 01 07:18:55.086774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 288/585] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:55.090445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:55.090919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:55.091370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:55.092042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:55.092490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:55.092912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:55.115602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lazy-loading 'flavor' on Instance uuid 56872759-8d04-492f-8020-a8143079785a {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:18:55.238599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21adff36-fd0d-41e9-a00a-8dfbcf871387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/action" status: 200 len: 32 microversion: 2.1 time: 0.160219 Sep 01 07:18:55.239195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 298/586] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:18:55 2022] POST /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:18:55.248687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:55.249357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:55.255798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:55.256272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:55.256702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:55.257410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:55.257859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:55.258750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:55.489593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:55.498650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07482a8a-7835-43f9-a641-a820e9967a74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.253949 Sep 01 07:18:55.499218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 289/587] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:56.087434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:56.089776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:56.095893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:56.096369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:56.096791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:56.097508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:56.097951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:56.098366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:56.128536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca71c5b2-bb5d-40d0-8920-c197ddfeee08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045872 Sep 01 07:18:56.129160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 299/588] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:56.524961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:56.525694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:56.531641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:56.532122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:56.532559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:56.533276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:56.533731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:56.534152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:56.659031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:56.667222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-03ead5b7-273f-4786-8fab-7206376a156e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.146076 Sep 01 07:18:56.667779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 290/589] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:57.141441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:57.144144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:57.150610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:57.151079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:57.151500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:57.152172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:57.152610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:57.153019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:57.184698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79ec24e8-58fa-47ab-ae6a-85fea5eda2a8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047122 Sep 01 07:18:57.185344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 300/590] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:57.687788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:57.688316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:57.695140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:57.695619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:57.696056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:57.696763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:57.697240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:57.697662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:57.822589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:57.831218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7c18866c-a680-48ac-81f3-3b6c41bf7f5b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.147293 Sep 01 07:18:57.831775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 291/591] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:58.196372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:58.198488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:58.204815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:58.205315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:58.205739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:58.206404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:58.206842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:58.207253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:58.235394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05a9034b-ae47-4a50-8274-1b4f92f8c8f5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042963 Sep 01 07:18:58.236443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 301/592] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:18:58.852435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:58.853075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:58.859405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:58.859886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:58.860321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:58.861003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:58.861486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:58.861928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:58.989700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:18:58.997808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d3ab69b9-0524-4ffc-8cc2-5878fa28edaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.149224 Sep 01 07:18:58.998372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 292/593] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:18:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:18:59.247976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:18:59.250132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:18:59.257091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:59.257592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:59.258023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:59.258704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:18:59.259153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:18:59.259572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:18:59.288879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b6230c1-a4fd-4199-84ad-7de0cc7b0696 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044898 Sep 01 07:18:59.289449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 302/594] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:18:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:00.019131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:00.019700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:00.026033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:00.026516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:00.026957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:00.027645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:00.028110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:00.028520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:00.154145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:00.162826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d909c7ef-cd46-476f-97e5-ad052ab5f10c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.147554 Sep 01 07:19:00.163402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 293/595] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:00.300990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:00.303126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:00.309439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:00.309912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:00.310729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:00.311407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:00.311850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:00.312267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:00.344502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3da7cbbb-bef5-4c9b-a8b0-2c70ef6a4079 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047903 Sep 01 07:19:00.345876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 303/596] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:01.183574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:01.184205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:01.186576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=54 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:01.192281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:01.192762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:01.193220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:01.193907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:01.194355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:01.194772 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:01.322185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:01.330160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f50ba04-d3fa-4d68-8ffd-028de850df4c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.150389 Sep 01 07:19:01.330721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 294/597] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:01.356482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:01.358602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:01.365484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:01.365962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:01.366388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:01.367070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:01.367512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:01.367926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:01.397207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b7eee15-cd71-47a4-8afb-caeb27051875 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044740 Sep 01 07:19:01.397758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 304/598] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:02.350243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:02.350853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:02.357284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:02.357769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:02.358203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:02.358892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:02.359343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:02.359767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:02.409567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:02.411728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:02.417826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:02.418302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:02.418736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:02.419424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:02.419872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:02.420326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:02.434555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:02.454162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-916a7eaf-73e1-4a43-9373-0a2e677c3200 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048541 Sep 01 07:19:02.455148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 305/599] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:02.490375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:02.498479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a7b7258-f2ec-4068-9d27-2a2cd4f466bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.152110 Sep 01 07:19:02.499050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 295/600] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:03.467636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:03.469926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:03.476663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:03.477079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:03.477538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:03.478219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:03.478662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:03.479078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:03.508614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4b22fb52-f937-48b5-81cc-a8c71c75eb14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044973 Sep 01 07:19:03.509176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 306/601] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:19:03.519298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:03.519904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:03.526323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:03.526808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:03.527248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:03.527978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:03.528388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:03.528810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:03.657422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:03.666061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb166023-8022-4702-aa89-33370811ceaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.150542 Sep 01 07:19:03.666623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 296/602] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:04.522125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:04.524251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:04.526527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=60 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:04.531782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:04.532263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:04.532699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:04.533408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:04.533855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:04.534276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:04.562796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f64ee8fb-d8af-4620-932f-67a24254d51d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045439 Sep 01 07:19:04.563351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 307/603] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:04.687865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:04.688471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:04.695475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:04.695954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:04.696585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:04.697858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:04.698691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:04.699468 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:04.828736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:04.837977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e596a816-d59f-4beb-8819-29a3a49c5ff5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.153682 Sep 01 07:19:04.838897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 297/604] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:05.575805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:05.577942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:05.584765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:05.585273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:05.585703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:05.586376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:05.586821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:05.587236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:05.617689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1093a868-7561-41e4-bfdc-fb7f57f402b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045851 Sep 01 07:19:05.618226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 308/605] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:05.859341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:05.859858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:05.866133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:05.866614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:05.867051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:05.867729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:05.868176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:05.868594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:06.144477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:06.152568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2cdf8d2a-b284-4c54-8a1b-8cc8dcf74ad6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.297184 Sep 01 07:19:06.153149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 298/606] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:06.629038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:06.631160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:06.637918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:06.638391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:06.638814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:06.639485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:06.639924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:06.640336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:06.669069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9bd46c0f-2d22-4291-b228-1471f035cace tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043988 Sep 01 07:19:06.669623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 309/607] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:07.172659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:07.174093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:07.183004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:07.183490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:07.183930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:07.184631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:07.185090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:07.185540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:07.313918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:07.322596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0866dbb2-0e8d-4546-b45d-521bf4804bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.153741 Sep 01 07:19:07.323161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 299/608] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:07.682046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:07.684113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:07.690458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:07.690929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:07.691358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:07.692030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:07.692475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:07.692890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:07.722172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19c97123-6f8e-4e3c-9782-f30502907adb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044208 Sep 01 07:19:07.722709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 310/609] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:08.343711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:08.344319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:08.350797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:08.351278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:08.351712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:08.352404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:08.352855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:08.353315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:08.539172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:08.547281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d6b7db2a-b675-437b-ba78-2033a9ce66f7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.207378 Sep 01 07:19:08.547839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 300/610] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:08.734276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:08.736894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:08.743144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:08.743616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:08.744043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:08.744713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:08.745174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:08.745591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:08.775074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d27969e-6d5e-4885-95a1-305f6f728276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044722 Sep 01 07:19:08.775626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 311/611] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:19:09.568911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:09.569664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:09.575923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:09.576411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:09.576854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:09.577578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:09.578033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:09.578460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:09.593381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:09.706474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:09.714523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2344a696-a544-4a7d-8133-8c8df78de0aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.149408 Sep 01 07:19:09.715088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 301/612] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:09.787305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:09.789441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:09.795825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:09.796292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:09.796714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:09.797406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:09.797849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:09.798260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:09.827606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a862b981-cbe1-48df-b899-33f7e955f027 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044332 Sep 01 07:19:09.828160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 312/613] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:09 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:10.839860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:10.840469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:10.841296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:10.843492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:10.846422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:10.847027 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:10.848004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:10.848699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:10.849175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:10.849603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:10.850543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:10.851024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:10.851457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:10.852167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:10.852951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:10.853746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:10.887206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab489d37-fd92-489a-a967-a8fbdeb4ff72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048969 Sep 01 07:19:10.887778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 313/614] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:19:10.978240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:10.986461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe8abc1d-df2c-4d77-a136-d57c83d30da6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1717 microversion: 2.1 time: 0.255060 Sep 01 07:19:10.987031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 302/615] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1717 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:11.045249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:11.045738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:11.051570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:11.052047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:11.052476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:11.053181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:11.053630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:11.054053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:11.272700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] HTTP exception thrown: Cannot 'detach_volume' instance 56872759-8d04-492f-8020-a8143079785a while it is in vm_state rescued Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Request method failure captured: Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments/0f3997af-a23f-40cb-b325-85a64d3e1aa7 HTTP/1.1 Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFvBFFWc6puLNPHy3F-IcgMhvUjqlMzltcrwUBajcvx1etWIhC2rrASYnuJiwBRHYoyD8sjqxApn2ay4Bz_snjhqHekqKNrQ35gssMqLakA1LiYaJ3o8-OnTjJW691ti3PrLANcHhrdA-DRzucAEK5xlDZeeZg7KGvIYpVA9rhtoR5Q Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: c1705474b7954cf1926e9beb2d548587 Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:19:11.274331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1705474b7954cf1926e9beb2d548587", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: c1705474b7954cf1926e9beb2d548587 Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-ServerRescueNegativeTestJSON-547052379-project Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: db4f0928502a43b490de01afc587a846 Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547052379-project Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:19:11.275732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Cannot 'detach_volume' instance 56872759-8d04-492f-8020-a8143079785a while it is in vm_state rescued Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'server_id': '56872759-8d04-492f-8020-a8143079785a', 'id': '0f3997af-a23f-40cb-b325-85a64d3e1aa7'} Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56872759-8d04-492f-8020-a8143079785a in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:19:11.276432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 56872759-8d04-492f-8020-a8143079785a while it is in vm_state rescued Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 56872759-8d04-492f-8020-a8143079785a while it is in vm_state rescued Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:19:11.277940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Returning 409 to user: Cannot 'detach_volume' instance 56872759-8d04-492f-8020-a8143079785a while it is in vm_state rescued {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:19:11.279165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2970911-8b9f-4fd5-997a-7beba9997ded tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments/0f3997af-a23f-40cb-b325-85a64d3e1aa7" status: 409 len: 152 microversion: 2.1 time: 0.234438 Sep 01 07:19:11.279165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 314/616] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:19:11 2022] DELETE /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments/0f3997af-a23f-40cb-b325-85a64d3e1aa7 => generated 152 bytes in 235 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 07:19:11.284567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:19:11.285103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:11.291038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:11.291526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:11.291966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:11.292653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:11.293123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:11.293564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:11.358586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34131857-09b3-4bbe-b664-c1cfce08b96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/action" status: 202 len: 0 microversion: 2.1 time: 0.077754 Sep 01 07:19:11.359311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 303/617] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:19:11 2022] POST /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:19:11.367578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:11.368191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:11.374942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:11.375434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:11.375935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:11.376623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:11.377108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:11.377562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:11.592696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:11.600919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f46beb11-e35f-4716-ab29-8cd629ccb318 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1725 microversion: 2.1 time: 0.237113 Sep 01 07:19:11.601509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 315/618] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:11.900543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:11.902999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:11.908976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:11.909999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:11.910440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:11.911129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:11.911586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:11.912013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:11.947029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5a58916-fdda-4dc0-aa69-b783f0fe0245 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051208 Sep 01 07:19:11.947831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 304/619] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:12.622358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:12.622974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:12.630010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:12.630493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:12.630922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:12.631600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:12.632043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:12.632461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:12.761856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:12.770917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7310e7b5-63a3-40bb-a495-72997364064c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1725 microversion: 2.1 time: 0.152664 Sep 01 07:19:12.771478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 316/620] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:12.959533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:12.961783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:12.968098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:12.968583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:12.969024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:12.969746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:12.970200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:12.970627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:13.000008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0855af37-0ad8-4144-ac65-a0b5bc593427 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044605 Sep 01 07:19:13.000490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 305/621] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:13.791799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:13.792447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:13.798843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:13.799314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:13.799759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:13.800434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:13.800875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:13.801327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:13.932043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:13.940085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-815aa1bc-d6f1-499e-8880-8a7ebda33949 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1725 microversion: 2.1 time: 0.152150 Sep 01 07:19:13.940635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 317/622] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:14.110252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:14.112341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:14.118187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:14.118665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:14.119096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:14.119771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:14.120220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:14.120637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:14.150077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2191fee8-ec36-47e6-bb82-d62e513ccab9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141260 Sep 01 07:19:14.150615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 306/623] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:14.961602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:14.962206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:14.968587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:14.969059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:14.969528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:14.970203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:14.970650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:14.971070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:14.999937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:19:15.000086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a (ip 10.222.0.46) !!! Sep 01 07:19:15.096888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:19:15.104976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0872635d-1737-48ec-add7-79b66d3a7a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1731 microversion: 2.1 time: 0.147258 Sep 01 07:19:15.105558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 318/624] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:19:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:19:15.124909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:15.125441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:15.132183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:15.132671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:15.133169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:15.133835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:15.134293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:15.134723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:15.161359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:15.163571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:15.169535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:15.170088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:15.170585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:15.171344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:15.171864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:15.172345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:15.207217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3175cdf9-ca88-4c7d-a178-3f310d78fe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049706 Sep 01 07:19:15.207787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 319/625] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:19:15.216252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-29bfe1a3-5393-46b3-93f0-0773c5fe2aa1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095095 Sep 01 07:19:15.216869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 307/626] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 07:19:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:16.219248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:16.221402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:16.228928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:16.229450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:16.229906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:16.230638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:16.231082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:16.231497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:16.262990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65ad3280-15c4-462a-9a05-7a8a86a0ffba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047702 Sep 01 07:19:16.263557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 320/627] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:16.473212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:19:16.474053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:19:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 01 07:19:16.475263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:19:16.475594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:19:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 01 07:19:16.483008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-59a1822f-febb-4814-a652-d1ced26d76b1 req-5fec1f76-7943-4618-8be1-89a2c3aa3a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56872759-8d04-492f-8020-a8143079785a", "tag": "4a7088df-c8f1-43bf-9d2a-48042b8faf52"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:19:16.497308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-59a1822f-febb-4814-a652-d1ced26d76b1 req-5fec1f76-7943-4618-8be1-89a2c3aa3a0b service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:16.498126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-59a1822f-febb-4814-a652-d1ced26d76b1 req-5fec1f76-7943-4618-8be1-89a2c3aa3a0b service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:16.498977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-59a1822f-febb-4814-a652-d1ced26d76b1 req-5fec1f76-7943-4618-8be1-89a2c3aa3a0b service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:16.510834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-59a1822f-febb-4814-a652-d1ced26d76b1 req-5fec1f76-7943-4618-8be1-89a2c3aa3a0b service nova] Creating event network-changed:4a7088df-c8f1-43bf-9d2a-48042b8faf52 for instance 56872759-8d04-492f-8020-a8143079785a on hv-cinder-73306 Sep 01 07:19:16.515824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-59a1822f-febb-4814-a652-d1ced26d76b1 req-5fec1f76-7943-4618-8be1-89a2c3aa3a0b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044203 Sep 01 07:19:16.516459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 308/628] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:17.275323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:17.277622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:17.285434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:17.286175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:17.286793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:17.287509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:17.287984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:17.288402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:17.320806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31d906ed-a8f2-4d82-98ed-1c58254b7409 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049384 Sep 01 07:19:17.321737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 321/629] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:18.334754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:18.336950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:18.343048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:18.343588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:18.344102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:18.344888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:18.345397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:18.345860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:18.375893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-13686eaa-1b27-4380-9a72-2f42d45c74ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046134 Sep 01 07:19:18.376477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 309/630] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:19:18.530087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ba933f98-468d-4d00-8206-ef329249cdfb req-9c56ed7e-57d8-421a-87d9-ad518f7aca24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56872759-8d04-492f-8020-a8143079785a", "tag": "4a7088df-c8f1-43bf-9d2a-48042b8faf52"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:19:18.540137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ba933f98-468d-4d00-8206-ef329249cdfb req-9c56ed7e-57d8-421a-87d9-ad518f7aca24 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:18.540598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ba933f98-468d-4d00-8206-ef329249cdfb req-9c56ed7e-57d8-421a-87d9-ad518f7aca24 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:18.541016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ba933f98-468d-4d00-8206-ef329249cdfb req-9c56ed7e-57d8-421a-87d9-ad518f7aca24 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:18.544606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:18.553539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ba933f98-468d-4d00-8206-ef329249cdfb req-9c56ed7e-57d8-421a-87d9-ad518f7aca24 service nova] Creating event network-changed:4a7088df-c8f1-43bf-9d2a-48042b8faf52 for instance 56872759-8d04-492f-8020-a8143079785a on hv-cinder-73306 Sep 01 07:19:18.558444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ba933f98-468d-4d00-8206-ef329249cdfb req-9c56ed7e-57d8-421a-87d9-ad518f7aca24 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032016 Sep 01 07:19:18.559001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 322/631] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:19.388152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:19.390324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:19.397266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:19.397755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:19.398195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:19.398892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:19.399348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:19.399763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:19.428384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf3c4597-e078-469b-a2e3-d7949ad1126a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044424 Sep 01 07:19:19.428931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 310/632] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:20.441035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:20.443284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:20.449309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:20.449776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:20.450205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:20.450871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:20.451307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:20.451717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:20.480641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3824123-a4b6-4fbe-8c5b-138415964d51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044441 Sep 01 07:19:20.481185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 323/633] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:21.491996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:21.494081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:21.500588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:21.501068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:21.501536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:21.502233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:21.502693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:21.503123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:21.536284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d9d4079-3621-43d9-92b1-5017f3415eab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048286 Sep 01 07:19:21.536847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 311/634] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:22.548566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:22.551336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:22.557699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:22.558172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:22.558600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:22.559274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:22.559716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:22.560131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:22.588132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-186fb6d6-24be-4dc4-8090-981a459da435 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043553 Sep 01 07:19:22.588667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 324/635] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:23.600247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:23.602344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:23.608772 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:23.609295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:23.609737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:23.610426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:23.610882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:23.611309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:23.642541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36723d6d-605c-4e74-9c54-5a0650f58c08 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046393 Sep 01 07:19:23.643089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 312/636] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:24.654802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:24.656943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:24.663939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:24.664409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:24.664836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:24.665546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:24.665989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:24.666407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:24.695191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59a6bd51-5a23-4d26-96aa-1420ab9d1f61 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044367 Sep 01 07:19:24.695717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 325/637] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:25.706379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:25.709060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:25.715127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:25.715608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:25.716039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:25.716719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:25.717196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:25.717622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:25.746400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e0a006f8-c92e-41d1-8dad-c61f1aeb66cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043998 Sep 01 07:19:25.746940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 313/638] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:26.759207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:26.761604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:26.768202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:26.768674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:26.769098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:26.769843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:26.770286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:26.770716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:26.800098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f73ef979-9523-4ad3-9d82-c423b785d7db tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Sep 01 07:19:26.801307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 326/639] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:27.812386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:27.814683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:27.821620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:27.822102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:27.822538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:27.823226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:27.823680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:27.824106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:27.852924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f890d26-96e6-41b9-87b2-52673e3011e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044510 Sep 01 07:19:27.853505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 314/640] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:28.865377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:28.867469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:28.873772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:28.874241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:28.874665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:28.875332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:28.875769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:28.876181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:28.907298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b36c69a-f2dd-417e-a53f-a696b5ef257e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045947 Sep 01 07:19:28.907893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 327/641] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:29.919973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:29.922124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:29.929202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:29.929678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:29.930108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:29.930787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:29.931238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:29.931654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:29.960808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9c48f4f-9f82-4d2f-b68a-a73049ec5ad5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044740 Sep 01 07:19:29.961724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 315/642] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:30.973645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:30.975717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:30.982126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:30.982591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:30.983016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:30.983685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:30.984146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:30.984593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:31.018647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5e15a4b-71cb-47b1-ae68-89660d6b294c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048798 Sep 01 07:19:31.019130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 328/643] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:32.030787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:32.032960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:32.035446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=44 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:32.040683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:32.041193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:32.041632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:32.042321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:32.042776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:32.043199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:32.071990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1febc821-0651-47d7-af74-a96051c07aca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045175 Sep 01 07:19:32.072539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 316/644] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:33.084556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:33.086703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:33.092645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:33.093247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:33.093674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:33.094341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:33.094809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:33.095223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:33.123655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24efc6da-a7a6-45f5-ac71-cf2a703a4070 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043888 Sep 01 07:19:33.124179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 329/645] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:33.469849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1245752128"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:19:33.470392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:33.476619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:33.477108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:33.477637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:33.478336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:33.478794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:33.479220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:33.616664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.network.security_group_api [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Removing security group 829adf0b-3799-431a-bba1-c0b0a7acd430 from port af5f2bad-da1c-41a1-9b9f-c7eac9bc052a Sep 01 07:19:33.921288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3e43d37-83db-47fe-861e-2cba5f71d3a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/action" status: 202 len: 0 microversion: 2.1 time: 0.455345 Sep 01 07:19:33.921897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 317/646] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:19:33 2022] POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:19:33.993698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-bd61d6ce-6206-4b5c-8ed0-3221067a5b3c req-644ad2dd-7d57-4a3a-8739-e2ac255f6207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ac467b-0a5f-4e70-952c-3bead582e098", "tag": "af5f2bad-da1c-41a1-9b9f-c7eac9bc052a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:19:34.003846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-bd61d6ce-6206-4b5c-8ed0-3221067a5b3c req-644ad2dd-7d57-4a3a-8739-e2ac255f6207 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:34.004733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-bd61d6ce-6206-4b5c-8ed0-3221067a5b3c req-644ad2dd-7d57-4a3a-8739-e2ac255f6207 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:34.005413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-bd61d6ce-6206-4b5c-8ed0-3221067a5b3c req-644ad2dd-7d57-4a3a-8739-e2ac255f6207 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:34.019067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-bd61d6ce-6206-4b5c-8ed0-3221067a5b3c req-644ad2dd-7d57-4a3a-8739-e2ac255f6207 service nova] Creating event network-changed:af5f2bad-da1c-41a1-9b9f-c7eac9bc052a for instance e1ac467b-0a5f-4e70-952c-3bead582e098 on hv-cinder-73306 Sep 01 07:19:34.025262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-bd61d6ce-6206-4b5c-8ed0-3221067a5b3c req-644ad2dd-7d57-4a3a-8739-e2ac255f6207 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098249 Sep 01 07:19:34.026239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 330/647] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:34.136121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:34.138650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:34.147009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:34.148222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:34.148829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:34.149747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:34.150360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:34.150945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:34.182053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:34.198083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db7abd2b-f513-4057-9d5d-b37c8ac01afa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065660 Sep 01 07:19:34.199252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 318/648] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:35.159631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:35.160208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:35.162803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=48 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:35.175751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:35.176302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:35.176756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:35.177616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:35.177986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:35.178531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:35.235399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-91219348-e8b2-441d-a3d5-e9be097a068e req-6ec72319-577e-479f-97a6-752b119485b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ac467b-0a5f-4e70-952c-3bead582e098", "tag": "af5f2bad-da1c-41a1-9b9f-c7eac9bc052a"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:19:35.245391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-91219348-e8b2-441d-a3d5-e9be097a068e req-6ec72319-577e-479f-97a6-752b119485b1 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:35.245880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-91219348-e8b2-441d-a3d5-e9be097a068e req-6ec72319-577e-479f-97a6-752b119485b1 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:35.246319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-91219348-e8b2-441d-a3d5-e9be097a068e req-6ec72319-577e-479f-97a6-752b119485b1 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:35.258244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-91219348-e8b2-441d-a3d5-e9be097a068e req-6ec72319-577e-479f-97a6-752b119485b1 service nova] Creating event network-changed:af5f2bad-da1c-41a1-9b9f-c7eac9bc052a for instance e1ac467b-0a5f-4e70-952c-3bead582e098 on hv-cinder-73306 Sep 01 07:19:35.266461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-91219348-e8b2-441d-a3d5-e9be097a068e req-6ec72319-577e-479f-97a6-752b119485b1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108914 Sep 01 07:19:35.267705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 319/649] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:19:35.267969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lazy-loading 'services' on Instance uuid e1ac467b-0a5f-4e70-952c-3bead582e098 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:19:35.276463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:35.278711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:35.285108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:35.285611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:35.286042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:35.286759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:35.287208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:35.287628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:35.321285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-079ca526-1d38-4ade-a152-8cc3b4a4ed20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048961 Sep 01 07:19:35.321864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 320/650] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:35.395428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed4af983-50c4-4f25-bc11-479887a072cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments/18802add-a9b8-4a4b-be55-a832bf196f14" status: 202 len: 0 microversion: 2.1 time: 0.240149 Sep 01 07:19:35.396111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 331/651] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:19:35 2022] DELETE /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments/18802add-a9b8-4a4b-be55-a832bf196f14 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:19:35.405880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:35.408769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:35.415729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:35.416544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:35.417237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:35.419192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:35.420238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:35.420880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:35.459279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe5baddd-5750-4d31-8699-e1808939c0d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057628 Sep 01 07:19:35.460508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 321/652] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:36.334958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:36.337737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:36.343837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:36.344309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:36.344734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:36.345433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:36.345883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:36.346297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:36.376068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed1f140a-d22e-4011-ac45-02f7b1b504ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046177 Sep 01 07:19:36.376613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 332/653] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:36.471887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:36.474224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:36.480560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:36.481048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:36.481518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:36.482210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:36.482664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:36.483088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:36.511608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab58b049-5133-47ca-9123-1fc8c565dd7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Sep 01 07:19:36.512148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 322/654] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:37.388200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:37.390313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:37.396627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:37.397099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:37.397606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:37.398240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:37.398684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:37.399104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:37.427980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-439a4d58-29d4-4257-83d6-5cc0b7a39bbb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043905 Sep 01 07:19:37.428455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 333/655] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:37.524428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:37.526593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:37.532820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:37.533349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:37.533795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:37.534485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:37.534945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:37.535373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:37.563959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b1dd4a51-b1d6-406f-8368-46a4c569b305 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Sep 01 07:19:37.564500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 323/656] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:38.439923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:38.442058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:38.444107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:19:38.444255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:19:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments (ip 10.222.0.46) !!! Sep 01 07:19:38.451294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:38.451710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:38.452140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:38.452815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:38.453288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:38.453705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:38.483052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48a8a197-0d24-434b-ac72-b9a01cb739ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047095 Sep 01 07:19:38.483596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 334/657] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:38.576433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:38.578592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:38.584999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:38.585514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:38.585959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:38.586651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:38.587102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:38.587523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:38.618598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9eebe4f8-8580-4725-b0da-8bd82a1c01d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046039 Sep 01 07:19:38.619155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 324/658] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:39.496255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:39.498287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:39.504565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:39.505030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:39.505482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:39.506180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:39.506615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:39.507032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:39.535807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00464a8d-5b27-411f-8345-21da063b7d41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044214 Sep 01 07:19:39.536357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 335/659] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:39.630909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:39.633033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:39.639692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:39.640175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:39.640617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:39.641341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:39.641799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:39.642223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:39.670663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f757194b-9af9-4284-95b4-7d0dce6e0bb0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Sep 01 07:19:39.671201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 325/660] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:40.547938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:40.550070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:40.556917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:40.557427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:40.557859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:40.558528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:40.558970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:40.559387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:40.587747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a612b0ef-b65c-4b0c-9e30-1fdf60103903 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043780 Sep 01 07:19:40.588280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 336/661] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:40.682785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:40.684890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:40.691183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:40.691658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:40.692094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:40.692774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:40.693259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:40.693682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:40.722020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3240c624-85e4-44a3-b771-19e52a944d3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043623 Sep 01 07:19:40.722571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 326/662] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:41.599701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:41.602290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:41.608520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:41.609015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:41.609486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:41.610140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:41.610579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:41.610991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:41.642088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aaa8d7fd-eb43-48fc-875c-e0ba87699ee0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046365 Sep 01 07:19:41.642634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 337/663] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:41.734011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:41.736125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:41.742442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:41.742923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:41.743362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:41.744046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:41.744497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:41.744919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:41.774518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c9940a4-0c3f-4901-929f-afd0b0cb7583 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Sep 01 07:19:41.775072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 327/664] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:42.653973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:42.655986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:42.662334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:42.662799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:42.663727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:42.664398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:42.664837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:42.665283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:42.698969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64438c9a-dc08-4ef9-98aa-121e6a9840de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048979 Sep 01 07:19:42.699512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 338/665] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:42.786670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:42.789460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:42.795811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:42.796288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:42.796717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:42.797419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:42.797869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:42.798287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:42.826025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b64f2a11-d066-41da-b810-ed4f26bb4925 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Sep 01 07:19:42.826564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 328/666] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:43.711430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:43.713598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:43.720487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:43.720948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:43.721552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:43.722166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:43.722607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:43.723073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:43.736463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:43.753204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dff387c2-591b-4efa-9c43-f4fc9af1ff29 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045788 Sep 01 07:19:43.753753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 339/667] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:43.837441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:43.839589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:43.845949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:43.846428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:43.846890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:43.847577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:43.848032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:43.848457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:43.876664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ec13f2de-85bc-47d6-90e9-66d8b76caa3b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043304 Sep 01 07:19:43.877218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 329/668] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:44.766414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:44.768516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:44.774870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:44.775348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:44.775779 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:44.776453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:44.776899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:44.777355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:44.806642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21e00ce3-7a3c-4450-9c9f-0d20b27172df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044208 Sep 01 07:19:44.807179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 340/669] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:44.888049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:44.890220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:44.896485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:44.896965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:44.897437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:44.898126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:44.898579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:44.899004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:44.927412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed24f380-489f-4821-bc8c-119a6333c2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043559 Sep 01 07:19:44.927951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 330/670] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:45.819297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:45.822152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:45.828558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:45.829035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:45.829504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:45.830184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:45.830630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:45.831049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:45.859465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8859a4b-086b-4438-b679-e86a979f2503 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044571 Sep 01 07:19:45.860011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 341/671] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:45.939819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:45.942046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:45.949047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:45.949561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:45.950035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:45.950718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:45.951171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:45.951597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:45.979622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-62d2081a-4fd9-4b46-8e33-7dbfea1b1cbe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Sep 01 07:19:45.980165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 331/672] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:46.871789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:46.873937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:46.880235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:46.880707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:46.881157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:46.881832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:46.882275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:46.882688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:46.911393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d4abaad-2c03-4ca2-b4ce-efa0ce379575 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043609 Sep 01 07:19:46.911926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 342/673] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:46.992161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:46.994335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:47.000571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:47.001047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:47.001509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:47.002183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:47.002626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:47.003042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:47.032377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4a5852d-1c0e-46a5-9da7-0f2cc2d85c84 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Sep 01 07:19:47.032915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 332/674] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:47.924669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:47.926796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:47.935206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:47.935695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:47.936498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:47.937584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:47.938033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:47.938451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:47.967717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-233bf219-46e9-4ccc-9567-0a44f6d3d049 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046990 Sep 01 07:19:47.968264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 343/675] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:48.044416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:48.046555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:48.052951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:48.053465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:48.053908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:48.054593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:48.055042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:48.055465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:48.083221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2117b8a6-2be0-4468-b5d7-691c76c704c8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042739 Sep 01 07:19:48.083755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 333/676] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:48.979914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:48.982104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:48.988425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:48.988896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:48.989358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:48.990038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:48.990482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:48.990903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:49.003379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:49.003869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:49.010224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:49.010962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:49.011397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:49.012080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:49.012532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:49.012953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:49.021189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-94157c47-213a-4f0d-83bb-03ece1b090ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045120 Sep 01 07:19:49.021689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 344/677] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:49.091234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lazy-loading 'services' on Instance uuid 56872759-8d04-492f-8020-a8143079785a {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:19:49.095937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:49.098078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:49.103874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:49.104349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:49.104782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:49.105496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:49.105944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:49.106360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:49.136742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f27278b9-5a47-45be-8d16-081b07c267b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Sep 01 07:19:49.137319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 345/678] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:19:49.164177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ab008c6-2046-44ab-b9fd-4779c07e5331 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments/0f3997af-a23f-40cb-b325-85a64d3e1aa7" status: 202 len: 0 microversion: 2.1 time: 0.163967 Sep 01 07:19:49.164761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 334/679] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:19:48 2022] DELETE /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments/0f3997af-a23f-40cb-b325-85a64d3e1aa7 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 07:19:49.173143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:49.175316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:49.181735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:49.182201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:49.182625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:49.183332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:49.183746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:49.184160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:49.214400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1451a288-0539-4311-b665-621493fa9e8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 01 07:19:49.214956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 346/680] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:50.034146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:50.036470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:50.043170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:50.043654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:50.044088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:50.044774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:50.045249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:50.045675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:50.049295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:50.076877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-789f1153-a9eb-43ca-8766-1a5f017cc381 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047102 Sep 01 07:19:50.077459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 335/681] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:50.147858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:50.150003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:50.156251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:50.156728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:50.157174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:50.157840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:50.158278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:50.158689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:50.187663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8de7594f-a5d1-4b84-993c-dd63d2f9ca37 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Sep 01 07:19:50.188209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 347/682] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:50.226136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:50.228755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:50.234694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:50.235179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:50.235614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:50.236302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:50.236757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:50.237213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:50.265964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d739ae0-c756-4183-9e4f-62bfb9166cd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043721 Sep 01 07:19:50.266510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 336/683] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:51.089091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:51.091200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:51.097078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:51.097585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:51.098014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:51.098687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:51.099131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:51.099546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:51.128280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10433769-617f-4fa1-bc30-54526ab10961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043147 Sep 01 07:19:51.128819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 348/684] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:51.200482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:51.202660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:51.208914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:51.209435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:51.209877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:51.210561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:51.211013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:51.211435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:51.239338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3976d2cd-034c-4ae5-8650-4d4775a831ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Sep 01 07:19:51.239967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 337/685] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:51.277941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:51.280137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:51.286447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:51.286916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:51.287342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:51.288021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:51.288463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:51.288877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:51.318147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6503c1f-b2a2-42db-ba71-84f6cefa6c76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Sep 01 07:19:51.319160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 349/686] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:52.141141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:52.143267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:52.149784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:52.150258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:52.150685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:52.151363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:52.151813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:52.152229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:52.181091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7c64abeb-f8fd-40d2-b186-a14254847434 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043929 Sep 01 07:19:52.181663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 338/687] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:52.252051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:52.254180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:52.260495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:52.261249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:52.261706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:52.262380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:52.262824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:52.263240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:52.292704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c16ef44d-b6b8-4d1a-8cb0-f78d255c02f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Sep 01 07:19:52.293331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 350/688] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:52.330996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:52.333181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:52.340124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:52.340651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:52.341086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:52.341798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:52.342246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:52.342670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:52.370923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c6b9b276-632f-46af-8995-bd13ffbdfbfd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Sep 01 07:19:52.371461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 339/689] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:53.193699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:53.196148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:53.202465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:53.202932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:53.203357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:53.204029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:53.204465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:53.204876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:53.235386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05cfa41c-d215-479e-87ec-3945201bd9e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045608 Sep 01 07:19:53.235932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 351/690] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:53.304744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:53.306935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:53.312860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:53.313373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:53.313813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:53.314499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:53.314954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:53.315379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:53.345013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85366811-8a5b-46d0-ac6e-1fd7df6376ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Sep 01 07:19:53.345662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 340/691] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:53.382943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:53.385041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:53.391562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:53.392027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:53.392453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:53.393144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:53.393580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:53.393993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:53.423531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f17310dc-6430-45df-8f95-94ab9cc64393 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Sep 01 07:19:53.424070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 352/692] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:54.247521 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:54.249762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:54.255730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:54.256206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:54.256636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:54.257356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:54.257804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:54.258224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:54.287239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-464da565-8291-4efa-a992-76c2a6319bc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043892 Sep 01 07:19:54.287796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 341/693] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:54.357093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:54.359270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:54.365802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:54.366268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:54.366690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:54.367358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:54.367816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:54.368226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:54.397129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd35b780-2910-4a9a-8634-44e6734dfe6d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043940 Sep 01 07:19:54.397746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 353/694] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:54.436058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:54.438260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:54.444828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:54.445346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:54.446452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:54.446972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:54.447422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:54.447842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:54.478425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a3b8b39d-09f2-445b-bab5-35bdeb917719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Sep 01 07:19:54.478971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 342/695] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:55.299909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:55.302031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:55.308391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:55.308862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:55.309313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:55.309982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:55.310422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:55.310831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:55.341455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c5678a8a-7df8-4614-a0c5-85b6eca0437e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045478 Sep 01 07:19:55.341996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 354/696] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:55.409378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:55.411872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:55.417750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:55.418223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:55.418652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:55.419327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:55.419789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:55.420187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:55.449742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10a21b58-531e-4cf3-9a58-b69dd0335984 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Sep 01 07:19:55.450355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 343/697] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:55.490443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:55.492530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:55.499297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:55.499768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:55.500193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:55.500860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:55.501332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:55.501745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:55.531260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d93cdc12-cbcd-43fd-908c-79028bf60bfa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Sep 01 07:19:55.531794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 355/698] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:56.354682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:56.356802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:56.362706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:56.363186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:56.363625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:56.364311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:56.364765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:56.365218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:56.394013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-934ee2b5-8e01-4517-8e40-b459e65ccefb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044040 Sep 01 07:19:56.394594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 344/699] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:56.462360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:56.464744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:56.470699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:56.471166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:56.471586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:56.472251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:56.472685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:56.473095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:56.476583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:19:56.502966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8735619f-b74b-4659-8260-653caa1397c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Sep 01 07:19:56.503574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 356/700] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:56.543245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:56.545416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:56.551258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:56.551741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:56.552181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:56.552866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:56.553356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:56.553781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:56.583713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9207d12-f35a-4e09-a9a6-d93ec7598cc0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Sep 01 07:19:56.584264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 345/701] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:57.406411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:57.408499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:57.414452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:57.415413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:57.415841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:57.416509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:57.416949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:57.417398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:57.446815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-989d52b7-1b6a-4849-bb5f-6fb8a03d1d89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044261 Sep 01 07:19:57.447276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 357/702] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:57.515121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:57.517300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:57.523508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:57.523993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:57.524429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:57.525146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:57.525588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:57.526010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:57.562007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dda4e749-2cfb-436d-8b8c-dc86a21dabc3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050951 Sep 01 07:19:57.562754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 346/703] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:57.595619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:57.597769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:57.604474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:57.604942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:57.605389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:57.606057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:57.606495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:57.606905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:57.635714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc9c481b-a7a4-4eb9-b145-9032d13b76e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Sep 01 07:19:57.636498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 358/704] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:58.458614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:58.460780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:58.467325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:58.467809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:58.468246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:58.468931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:58.469412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:58.469841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:58.498350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dcbd4b30-a420-4924-bbac-0cca0afb8ca7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043750 Sep 01 07:19:58.498894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 347/705] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:58.574747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:58.576834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:58.582693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:58.583154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:58.583575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:58.584240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:58.584677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:58.585084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:58.613702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d0ceeee-0f4a-4a59-aaad-4d712a005509 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Sep 01 07:19:58.614345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 359/706] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:58.647748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:58.649918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:58.656542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:58.656974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:58.657453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:58.658145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:58.658608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:58.659037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:58.688021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f56ceb8d-cc03-4b15-9d45-9fede145e488 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Sep 01 07:19:58.688560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 348/707] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:59.510575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:59.512902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:59.518773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:59.519249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:59.519670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:59.520334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:59.520772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:59.521214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:59.550340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-877ad750-f43d-4ab5-b846-459afbece429 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043757 Sep 01 07:19:59.550853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 360/708] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:19:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:19:59.625620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:59.627745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:59.634240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:59.634726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:59.635165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:59.636113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:59.636570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:59.636993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:59.665931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c422378f-37bf-4e96-9a24-b8d9cfb154d6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Sep 01 07:19:59.666506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 349/709] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:19:59.700288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:19:59.702403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:19:59.708686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:59.709184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:59.709620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:59.710297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:19:59.710740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:19:59.711157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:19:59.739891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e96e94e5-8bb1-44a3-881c-97efdb3dec21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Sep 01 07:19:59.740449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 361/710] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:19:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:00.562521 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:00.564630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:00.570517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:00.570998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:00.571430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:00.572109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:00.572557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:00.573006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:00.603576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c3e9674-0e60-424f-921e-0541e40b4dd6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044914 Sep 01 07:20:00.604146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 350/711] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:00.678021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:00.680787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:00.686837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:00.687384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:00.687877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:00.688624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:00.689142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:00.689651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:00.718894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6062516f-dcc4-4762-ab35-45dc3340a8ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Sep 01 07:20:00.721253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 362/712] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:00.752259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:00.754412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:00.761499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:00.761809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:00.762246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:00.762941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:00.763387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:00.763804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:00.789306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:00.795011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d61e1de7-2aef-4547-931c-f0f4c7553c39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046952 Sep 01 07:20:00.795572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 351/713] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:01.615835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:01.618725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:01.624566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:01.625034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:01.625489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:01.626157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:01.626594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:01.627004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:01.655877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d4d321e-e226-4677-8e48-36dd725d74fe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044554 Sep 01 07:20:01.656410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 363/714] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:01.731035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:01.733157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:01.739340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:01.739820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:01.740252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:01.740932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:01.741402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:01.741824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:01.771734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b203414b-9285-4cca-a281-ca2c66e3da9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 Sep 01 07:20:01.772290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 352/715] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:01.807275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:01.809451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:01.815280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:01.815748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:01.816169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:01.817101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:01.817571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:01.817983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:01.846785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1770830-8e72-409b-98eb-17819a2777f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043835 Sep 01 07:20:01.847330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 364/716] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:02.668740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:02.670886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:02.672717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=74 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:02.677974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:02.678448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:02.678877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:02.679574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:02.680004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:02.681014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:02.709510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-511377db-a07b-42ec-adcf-d8b7bc38b3c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045240 Sep 01 07:20:02.710048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 353/717] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:02.783772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:02.785842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:02.792656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:02.793145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:02.793578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:02.794250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:02.794690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:02.795107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:02.823532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e443235-e2ba-4add-9515-e71cb5a1d719 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Sep 01 07:20:02.824135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 365/718] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:02.859031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:02.861181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:02.867375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:02.868473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:02.868991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:02.869702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:02.870152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:02.870572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:02.899887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bd8ca4a1-a6eb-4d94-8811-85e58d842cfb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Sep 01 07:20:02.900431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 354/719] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:03.721990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:03.724107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:03.730088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:03.730558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:03.730979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:03.731646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:03.732082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:03.732506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:03.762018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00e10b6e-3473-40a9-80fc-ec5765f12ff5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044026 Sep 01 07:20:03.762570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 366/720] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:03.836184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:03.838965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:03.845015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:03.845522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:03.845962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:03.846639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:03.847087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:03.847501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:03.875841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cebd824-13ec-4c66-8009-3933c2fe83ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Sep 01 07:20:03.876392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 355/721] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:03.911693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:03.913822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:03.920695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:03.921197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:03.921632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:03.922311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:03.922756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:03.923172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:03.951169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1103c36-b403-4046-9379-47d10a413eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 Sep 01 07:20:03.951718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 367/722] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:04.774517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:04.776659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:04.782532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:04.783066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:04.783450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:04.784136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:04.784588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:04.785013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:04.813687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e398bd7-0d8c-4047-a450-9e93e20536ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043160 Sep 01 07:20:04.814248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 356/723] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:04.888723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:04.890845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:04.896640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:04.897108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:04.897562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:04.898222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:04.898657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:04.899093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:04.927669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88622f63-75cb-4d3c-baac-afa49a480978 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Sep 01 07:20:04.928210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 368/724] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:04 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:04.963851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:04.965993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:04.972400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:04.972878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:04.973352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:04.974043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:04.974502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:04.974923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:05.004970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-058e7bb9-fe7f-4865-8389-f8a6521a39d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Sep 01 07:20:05.005556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 357/725] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:05.826694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:05.828826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:05.830749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=76 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:05.838909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:05.839384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:05.839813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:05.840500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:05.840943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:05.841393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:05.873957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db32afe8-661f-4838-9a7e-08292993cbea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051189 Sep 01 07:20:05.874512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 369/726] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:05.940360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:05.942564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:05.949304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:05.949786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:05.950247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:05.950932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:05.951381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:05.951804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:05.985338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-536e30a0-7332-4501-9771-8cabcdcb6ab6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048958 Sep 01 07:20:05.985983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 358/727] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:06.017774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:06.019832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:06.026610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:06.027406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:06.027842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:06.029021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:06.029518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:06.029941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:06.061524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-99261f60-9a07-42cc-ac50-c4bd5c7f9f89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048193 Sep 01 07:20:06.062053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 370/728] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:06.886733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:06.888824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:06.894756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:06.895240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:06.895677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:06.896370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:06.896823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:06.897283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:06.926558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-09517dc1-f822-4e1a-9961-2af5f05ab5a7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044092 Sep 01 07:20:06.927052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 359/729] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:06.997321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:06.999434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:07.005418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:07.005891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:07.006317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:07.006989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:07.007431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:07.007855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:07.040532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33291c33-8a91-4d81-94b5-b845c4ab1b17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046615 Sep 01 07:20:07.041230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 371/730] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:07.073671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:07.075828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:07.082141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:07.082629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:07.083075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:07.083754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:07.084204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:07.084630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:07.113853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07d78428-c1d9-4d0b-b2ae-1e8abd583232 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 Sep 01 07:20:07.114390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 360/731] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:07.938513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:07.940638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:07.946637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:07.947106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:07.947533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:07.948205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:07.948649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:07.949062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:07.973385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:07.978858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-760c464e-961b-4832-9917-755496ec9072 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044382 Sep 01 07:20:07.979410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 372/732] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:08.052412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:08.054593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:08.060984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:08.061491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:08.061925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:08.062605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:08.063051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:08.063472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:08.091406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-04545fef-fa69-44ed-bdc7-6f4560daee8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043132 Sep 01 07:20:08.092017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 361/733] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:08.126045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:08.128140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:08.134343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:08.134811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:08.135245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:08.135909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:08.136609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:08.137023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:08.165873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-90e870ac-0e8d-43e8-ab1b-abecee3f0fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Sep 01 07:20:08.166402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 373/734] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:08.991413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:08.994058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:08.999927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:09.000411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:09.000849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:09.001567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:09.002020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:09.002447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:09.035297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-940ba211-327a-4e5b-8504-d5b4cd1444b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048125 Sep 01 07:20:09.035859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 362/735] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:09.103657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:09.105808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:09.111678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:09.112154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:09.112587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:09.113295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:09.113742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:09.114196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:09.143967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd13a204-1c22-4d4d-a5bd-c926175dae51 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Sep 01 07:20:09.144579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 374/736] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:09.177855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:09.180526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:09.186843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:09.187326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:09.187763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:09.188450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:09.188932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:09.189378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:09.218520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d367208a-d45d-4c56-92fe-286f8e5e2cf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Sep 01 07:20:09.219062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 363/737] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:10.047013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:10.049156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:10.054994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:10.055462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:10.055886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:10.056551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:10.056985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:10.057425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:10.087010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6ab5a77-0616-4cb8-9666-7c8e1b145d35 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043533 Sep 01 07:20:10.087567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 375/738] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:10.155830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:10.157983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:10.163874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:10.164387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:10.164828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:10.165543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:10.165996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:10.166419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:10.194588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8febfc38-813d-4037-bf5a-74eb32678d8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042716 Sep 01 07:20:10.195329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 364/739] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:10.229863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:10.231950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:10.238430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:10.238903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:10.239331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:10.240000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:10.240440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:10.240855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:10.269770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8850e286-5076-4430-89e9-691e140765e7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043809 Sep 01 07:20:10.270313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 376/740] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:11.099050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:11.101267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:11.107655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:11.108138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:11.108576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:11.109320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:11.109774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:11.110196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:11.139846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8e6faa4-6633-4529-bdf0-381923d62e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044685 Sep 01 07:20:11.140393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 365/741] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:11.207052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:11.209196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:11.215261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:11.215727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:11.216154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:11.216821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:11.217293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:11.217707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:11.246730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bbaae95c-e090-41f3-b8b6-05afa4d8bc86 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Sep 01 07:20:11.247335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 377/742] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:11.282292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:11.284439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:11.291398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:11.291881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:11.292319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:11.293007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:11.293495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:11.293924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:11.322122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c5f05f57-e997-48c6-8a02-05d0500612da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043734 Sep 01 07:20:11.322659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 366/743] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:12.152255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:12.154394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:12.160219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:12.160684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:12.161108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:12.161804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:12.162239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:12.162647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:12.191082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86898478-82ed-408e-bf56-2c5eb23a997e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043249 Sep 01 07:20:12.191612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 378/744] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:12.258807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:12.260926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:12.267006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:12.267487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:12.267923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:12.268607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:12.269060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:12.269510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:12.302755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df8a3e32-382e-45ac-b8cf-f5ca390de9d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047825 Sep 01 07:20:12.303427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 367/745] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:12.334679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:12.337409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:12.344132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:12.344599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:12.345027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:12.345797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:12.346234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:12.346648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:12.375627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e86bfcb-2a3d-412f-94e4-ede95e50eee7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Sep 01 07:20:12.376099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 379/746] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:20:13.203202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:13.205346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:13.211194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:13.211678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:13.212115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:13.212812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:13.213290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:13.213717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:13.227458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:13.243820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59801307-7a2a-4d00-a5d2-82538251a2d1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044569 Sep 01 07:20:13.244376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 368/747] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:13.315257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:13.317388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:13.323207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:13.323675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:13.324089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:13.324760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:13.325220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:13.325638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:13.354515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5cf9aba6-9894-4310-b25b-3c2393a53bb3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043110 Sep 01 07:20:13.355137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 380/748] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:13.388102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:13.390295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:13.396654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:13.397159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:13.397603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:13.398287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:13.398740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:13.399164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:13.427975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3549b92b-d72e-4807-931b-7145afc6b4b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Sep 01 07:20:13.428453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 369/749] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:14.255893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:14.258041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:14.264667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:14.265162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:14.265593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:14.266260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:14.266700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:14.267116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:14.295096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dfaa24b9-ee14-4128-b1d4-4e859b42891b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043174 Sep 01 07:20:14.295633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 381/750] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:14.366530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:14.369229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:14.375111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:14.375589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:14.376017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:14.376700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:14.377174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:14.377598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:14.407087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cf92957-94fb-4f54-be3f-5b015d01be30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Sep 01 07:20:14.407703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 370/751] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:14.439744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:14.441827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:14.449530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:14.449681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:14.450429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:14.450788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:14.451446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:14.451947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:14.482178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-400bf821-858a-4ef9-862a-198a4c415c5e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046322 Sep 01 07:20:14.482729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 382/752] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:15.307249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:15.309458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:15.315263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:15.315739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:15.316171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:15.316851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:15.317338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:15.317761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:15.348925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-800a0dce-c6ca-42b2-970e-4c783ece2267 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045638 Sep 01 07:20:15.349488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 371/753] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:15.419360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:15.421528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:15.427365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:15.427840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:15.428270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:15.428960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:15.429426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:15.429845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:15.458251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8657c753-d34e-43da-ad75-7130264c3d4d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042826 Sep 01 07:20:15.458827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 383/754] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:20:15.493306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:15.495430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:15.501709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:15.502186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:15.502619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:15.503298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:15.503750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:15.504168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:15.534676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d63dfe73-eef9-4c00-bc19-996be01d16b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045266 Sep 01 07:20:15.535220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 372/755] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:16.361656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:16.364013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:16.370458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:16.370923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:16.371345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:16.372013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:16.372448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:16.372857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:16.401294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e519e92-e0ae-4d86-b218-909f9c661b89 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043528 Sep 01 07:20:16.401862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 384/756] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:16.470657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:16.472822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:16.479251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:16.479738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:16.480180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:16.480869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:16.481359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:16.481788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:16.510586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-833c01b5-3873-4290-85bf-1846e8561126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Sep 01 07:20:16.511411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 373/757] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:16.546743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:16.548973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:16.555266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:16.555729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:16.556149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:16.556813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:16.557279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:16.557692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:16.586116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec37366a-6c36-47fa-9a33-10a35498d99e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043267 Sep 01 07:20:16.587158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 385/758] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:17.412954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:17.415170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:17.421214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:17.421684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:17.422121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:17.422820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:17.423275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:17.423700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:17.453634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca63b83d-8766-4c2c-add2-be98d5af1657 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044719 Sep 01 07:20:17.454186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 374/759] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:17.522476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:17.524860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:17.531032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:17.531543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:17.531974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:17.532756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:17.533155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:17.533568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:17.565531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35366897-8104-4e6e-9a67-28f90a3ffc07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Sep 01 07:20:17.566178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 386/760] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:17.598563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:17.600751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:17.607023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:17.607504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:17.607936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:17.608623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:17.609083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:17.609529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:17.639081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-82b631ea-e8f0-4283-8851-de8cf6036f87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Sep 01 07:20:17.639555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 375/761] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:18.466869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:18.468932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:18.474925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:18.475425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:18.475855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:18.476528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:18.476975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:18.477394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:18.506110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-340fede3-8c49-4c07-8356-017e1f644965 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043882 Sep 01 07:20:18.506658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 387/762] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:18.577398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:18.579502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:18.585378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:18.585861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:18.586292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:18.587576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:18.588057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:18.588476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:18.617333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d05bf0c-b326-48f0-a9fd-45bb3fe65ec4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043814 Sep 01 07:20:18.617973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 376/763] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:18.651572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:18.653763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:18.660081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:18.660559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:18.660994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:18.661712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:18.662158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:18.662577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:18.690998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5fd4cad8-717d-4441-a87e-865dfa5b7163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Sep 01 07:20:18.691551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 388/764] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:19.518885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:19.521025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:19.527536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:19.528020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:19.528458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:19.529171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:19.529631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:19.530053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:19.559004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-707fcb5a-efc2-444d-95f0-8153e47cdb9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044174 Sep 01 07:20:19.559543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 377/765] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:19.629659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:19.631713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:19.637900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:19.638374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:19.638802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:19.639474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:19.639917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:19.640335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:19.654152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:19.671018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-629f5145-07ab-431d-a1fb-63b5be13aa32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045395 Sep 01 07:20:19.671562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 389/766] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:19.702957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:19.705241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:19.711517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:19.712507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:19.712945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:19.713660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:19.714113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:19.714568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:19.743214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08b781fe-9229-4c8b-9e66-ef027904172a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Sep 01 07:20:19.743749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 378/767] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:20.570625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:20.572768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:20.578720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:20.579190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:20.579621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:20.580295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:20.580737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:20.581177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:20.610848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7968ed8-89c5-4dc3-a35d-f0f5017ee8c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044183 Sep 01 07:20:20.611324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 390/768] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:20.683617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:20.685808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:20.691884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:20.692360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:20.692792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:20.693494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:20.693946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:20.694368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:20.723658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1118a178-158c-4ea1-b6f7-2e02b9af8345 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043949 Sep 01 07:20:20.724232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 379/769] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:20.755110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:20.757436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:20.764596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:20.765151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:20.765707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:20.766462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:20.766916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:20.767459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:20.796628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eeb80357-0e86-4396-aa90-2c2c49e81d29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Sep 01 07:20:20.797202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 391/770] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:21.623545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:21.625775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:21.631638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:21.632122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:21.632596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:21.633322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:21.634281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:21.634711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:21.663816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37930d5f-3339-4dbe-9d35-68e2d82d66bb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044296 Sep 01 07:20:21.664369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 380/771] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:20:21.735708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:21.737839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:21.744234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:21.744710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:21.745165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:21.745844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:21.746288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:21.746711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:21.777272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-944ba3e9-aa16-4db9-a431-c842519bda36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Sep 01 07:20:21.778088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 392/772] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:21.808310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:21.810467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:21.816809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:21.817330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:21.817767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:21.818451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:21.818902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:21.819324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:21.848158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3d51031b-1381-4d3a-ad42-70a6c23c1028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Sep 01 07:20:21.848731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 381/773] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:22.676063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:22.678122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:22.683937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:22.684405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:22.684824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:22.685512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:22.685950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:22.686362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:22.714786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d05966a-2376-4a5d-a6ff-b03c21f0fb7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042871 Sep 01 07:20:22.715312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 393/774] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:22.789927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:22.792619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:22.798583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:22.799063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:22.799505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:22.800192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:22.800646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:22.801074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:22.829332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f186eccd-b9b4-4a05-b233-cbab5a139028 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043326 Sep 01 07:20:22.829916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 382/775] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:22.859615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:22.861743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:22.867976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:22.868500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:22.868929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:22.869631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:22.870075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:22.870490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:22.900105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af3b24fc-697b-481f-a5f3-2bbe712fed40 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Sep 01 07:20:22.900643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 394/776] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:23.727082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:23.729777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:23.735923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:23.736416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:23.736854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:23.737574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:23.738030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:23.738457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:23.768269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c76f748-23b1-4073-af81-5e6775f83bd7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045244 Sep 01 07:20:23.768836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 383/777] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:23.842161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:23.844268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:23.850231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:23.850703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:23.851137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:23.851810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:23.852254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:23.852670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:23.880710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04e65b38-3a39-4ebd-b18d-4e7632a26467 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Sep 01 07:20:23.881310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 395/778] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:23.911780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:23.913930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:23.920194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:23.920682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:23.921149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:23.921843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:23.922301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:23.922739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:23.951915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-984f261a-527d-46a3-9650-f64ff4067943 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Sep 01 07:20:23.952466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 384/779] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:24.779936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:24.782099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:24.787957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:24.788428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:24.788865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:24.789578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:24.790022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:24.790437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:24.819435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9d85587-7e10-4fb0-9328-d5c5936747af tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043458 Sep 01 07:20:24.819979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 396/780] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:24.892682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:24.894825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:24.901238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:24.901729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:24.902248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:24.902950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:24.903519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:24.904032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:24.906746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:24.935337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d8a53f95-7105-4356-85ce-2cdfcc499be5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046540 Sep 01 07:20:24.935922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 385/781] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:24 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:24.964065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:24.966187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:24.972483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:24.972946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:24.973394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:24.974061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:24.974501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:24.974911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:25.003814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc1f3dac-7f29-4669-92cd-4ec3dcc63b1f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Sep 01 07:20:25.004348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 397/782] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:25.832354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:25.834520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:25.840438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:25.840910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:25.841375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:25.842049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:25.842497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:25.842915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:25.872810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-91487f0f-271c-4719-b8df-b06a820e98e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044744 Sep 01 07:20:25.873382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 386/783] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:25.947492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:25.949686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:25.955622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:25.956094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:25.956523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:25.957227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:25.957672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:25.958090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:25.988406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1128b4e-820f-415f-8bf4-3bbe5c926c75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044836 Sep 01 07:20:25.989039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 398/784] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:26.016011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:26.018220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:26.023962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:26.024440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:26.024870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:26.026075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:26.026522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:26.026942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:26.055292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc6c9f2c-0709-45b7-9726-00ac94229078 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Sep 01 07:20:26.055855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 387/785] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:26.885246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:26.887670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:26.893569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:26.894053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:26.894486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:26.895167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:26.895614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:26.896035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:26.925441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-844c6ee4-6f18-45f5-9048-cdc7d717ed32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044188 Sep 01 07:20:26.925984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 399/786] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:27.000379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:27.002504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:27.008723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:27.009234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:27.010182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:27.010858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:27.011562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:27.011981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:27.040314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0fbbc7da-85cc-44f8-bdba-647dcb6524a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Sep 01 07:20:27.040903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 388/787] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:27.067746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:27.069919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:27.076748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:27.077258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:27.077696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:27.078377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:27.078828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:27.079250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:27.108506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1dd4c83b-cc22-4629-a583-d4d48ed2d193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Sep 01 07:20:27.109032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 400/788] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:27.938278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:27.940330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:27.946202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:27.946686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:27.947699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:27.948387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:27.948844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:27.949310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:27.977334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-70560dcd-dac2-4abe-a95f-a3ed734fcd45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043063 Sep 01 07:20:27.977877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 389/789] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:28.051888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:28.054016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:28.060582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:28.061050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:28.061509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:28.062182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:28.062624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:28.063040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:28.091594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-240c7e1a-bbf7-4d51-8552-96cedffd3dd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Sep 01 07:20:28.092179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 401/790] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:28.120514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:28.122645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:28.128869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:28.129392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:28.129818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:28.130495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:28.130943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:28.131359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:28.160069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-997d848a-2bf2-4718-8c5b-b54bcd16b44e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Sep 01 07:20:28.160606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 390/791] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:28.989640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:28.991671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:28.997643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:28.998119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:28.998550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:28.999236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:28.999682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:29.000096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:29.030047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3fbafe5-1f0e-42b3-bb8c-bee8ea65f26f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044451 Sep 01 07:20:29.030602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 402/792] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:29.104315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:29.106473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:29.112256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:29.112735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:29.113196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:29.113880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:29.114336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:29.114758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:29.142886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1cfff53f-ebc5-4396-8681-f9d6ef786abe tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043138 Sep 01 07:20:29.143467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 391/793] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:29.172715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:29.174847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:29.181184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:29.181667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:29.182094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:29.182767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:29.183208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:29.183623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:29.212254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cae7619-1483-4b69-901b-f38bb10f81cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043410 Sep 01 07:20:29.213340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 403/794] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:30.042792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:30.044957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:30.050764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:30.051243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:30.051677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:30.052359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:30.052805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:30.053258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:30.082014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-abf05b5d-6c3e-41f9-8a9e-8e9cd26d0ae4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043760 Sep 01 07:20:30.082550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 392/795] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:30.154885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:30.157044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:30.163027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:30.163501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:30.163929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:30.164598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:30.165043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:30.165482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:30.194758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46f749bf-5928-4862-ac90-0ca4bb1e6d92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Sep 01 07:20:30.195423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 404/796] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:30.224300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:30.226407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:30.233277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:30.233772 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:30.234215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:30.234904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:30.235357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:30.235785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:30.268127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10bf087e-65b5-4168-9c74-82a49a9fad71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047716 Sep 01 07:20:30.268706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 393/797] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:31.094673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:31.096775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:31.102656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:31.103780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:31.104207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:31.104874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:31.105345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:31.105760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:31.134097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c99b8212-5762-4a67-b83b-81b342956a03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043342 Sep 01 07:20:31.134629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 405/798] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:31.206769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:31.208883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:31.215593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:31.216073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:31.216508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:31.217218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:31.217674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:31.218097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:31.246623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-deaeb843-c87e-4137-b9fb-93ad964ec819 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Sep 01 07:20:31.247284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 394/799] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:20:31.280593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:31.282691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:31.288913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:31.289415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:31.289840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:31.290512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:31.290949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:31.291357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:31.294840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:31.320169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03b8810b-fb30-4c83-9539-d9d24fc5e929 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Sep 01 07:20:31.320704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 406/800] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:32.146559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:32.148699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:32.154611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:32.155091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:32.155530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:32.156212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:32.156664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:32.157087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:32.186622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f9993ec9-7476-4404-85a9-73252b1648f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044062 Sep 01 07:20:32.187175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 395/801] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:32.258938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:32.261240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:32.267542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:32.268012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:32.268443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:32.269137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:32.269593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:32.270008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:32.300128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2246db3-f997-4397-9c3d-ea042d0bbe23 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Sep 01 07:20:32.300816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 407/802] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:32.332649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:32.334792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:32.341699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:32.342183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:32.342622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:32.343310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:32.343765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:32.344188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:32.380624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d1c17615-01ad-4297-8cc1-bf3f53ed85b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051843 Sep 01 07:20:32.381201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 396/803] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:33.199806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:33.201998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:33.208054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:33.208531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:33.208968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:33.209738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:33.210192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:33.210612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:33.239155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16807a63-5b09-497b-ba8e-01327f3d8d70 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044231 Sep 01 07:20:33.239700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 408/804] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:33.312685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:33.314851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:33.316688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:33.321895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:33.322954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:33.323396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:33.324094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:33.324548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:33.324975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:33.354421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ad26a10e-176b-4647-9d97-f9072c33c99f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045600 Sep 01 07:20:33.355032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 397/805] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:33.392037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:33.394162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:33.400392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:33.400863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:33.401326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:33.401998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:33.402437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:33.402846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:33.432017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64e14b4c-6f0d-4fc3-afde-2fe7af9a93e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043235 Sep 01 07:20:33.432560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 409/806] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:34.251483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:34.253632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:34.259492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:34.260466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:34.260900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:34.261855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:34.262304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:34.262724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:34.291404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fa43c7d-fd4c-4a53-b018-b9c9c8716a4d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043915 Sep 01 07:20:34.291941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 398/807] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:34.366081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:34.368206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:34.374097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:34.374568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:34.374996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:34.375670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:34.376114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:34.376561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:34.406904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d9753a9-fe16-4715-aaf0-c2857be60f5f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Sep 01 07:20:34.407518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 410/808] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:34.443165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:34.445298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:34.452166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:34.452644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:34.453079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:34.453848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:34.454562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:34.454661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:34.484958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b2d98dd-c460-4327-aa7a-1b7bf06e6cdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Sep 01 07:20:34.485546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 399/809] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:35.303594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:35.305739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:35.311567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:35.312042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:35.312472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:35.313165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:35.313613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:35.314038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:35.343293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a6e3423-39a6-4029-902d-ece17bcba0b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043693 Sep 01 07:20:35.343838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 411/810] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:35.419634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:35.421859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:35.427860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:35.428350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:35.428794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:35.429524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:35.429986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:35.430415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:35.458802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8e587fb8-b3fd-41ea-a861-0503ce33194b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Sep 01 07:20:35.459384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 400/811] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:35.496923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:35.499070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:35.505382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:35.505854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:35.506283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:35.506952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:35.507398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:35.507814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:35.536670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef29106c-285c-4cfa-b39d-0110180de1ad tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Sep 01 07:20:35.537226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 412/812] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:36.355620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:36.357792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:36.363750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:36.364234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:36.364671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:36.365384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:36.365836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:36.366260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:36.392026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:36.397408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26075e86-b8fd-485d-b3a0-46d0cc4d9c7d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045803 Sep 01 07:20:36.397962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 401/813] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:36.471565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:36.473736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:36.475556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:36.481332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:36.481798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:36.482218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:36.482884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:36.483320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:36.483729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:36.513086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ecf38778-d287-49f0-9218-6db73354a6b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Sep 01 07:20:36.513704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 413/814] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:36.548141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:36.550335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:36.557252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:36.557737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:36.558173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:36.558857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:36.559311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:36.559736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:36.587967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c3eb643a-f5a2-42ce-ba77-5fd8debba5ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Sep 01 07:20:36.588505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 402/815] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:37.410419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:37.412536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:37.418443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:37.418911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:37.419331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:37.419999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:37.420440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:37.420853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:37.449893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d42738f6-0e11-45c9-b631-14a295f264c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043339 Sep 01 07:20:37.450368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 414/816] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:37.526157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:37.528275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:37.534131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:37.534615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:37.535051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:37.535736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:37.536190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:37.536615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:37.565519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-501cdc4c-8e5e-4a0d-8d8f-a60184c6990d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043199 Sep 01 07:20:37.566147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 403/817] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:37.599699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:37.601852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:37.608119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:37.608588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:37.609037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:37.609727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:37.610164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:37.610576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:37.640043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4957b63-fdc1-41ba-a502-b4d1ec37bcfc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Sep 01 07:20:37.640614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 415/818] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:38.462388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:38.465140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:38.470976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:38.471456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:38.471888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:38.472567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:38.473013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:38.473490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:38.502841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4bf9ee26-d462-4386-a6f2-ccc2e82631df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044340 Sep 01 07:20:38.503384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 404/819] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:38.578249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:38.580407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:38.586387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:38.586861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:38.587291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:38.587968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:38.588416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:38.588828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:38.617544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04e67cc7-4004-4173-8721-1158ea57e2a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Sep 01 07:20:38.618398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 416/820] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:38.652093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:38.654218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:38.660513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:38.660986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:38.661472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:38.662148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:38.662597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:38.663046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:38.693009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a09b371-d8d5-48db-8ff6-f70f5d9965a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Sep 01 07:20:38.693573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 405/821] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:39.515438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:39.517562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:39.523509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:39.523980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:39.524406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:39.525077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:39.525543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:39.525958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:39.554555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66441217-1ffb-48ce-82c8-ad0f799f2105 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043439 Sep 01 07:20:39.555099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 417/822] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:39.629734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:39.631837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:39.637912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:39.638389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:39.638825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:39.639503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:39.639980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:39.640397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:39.669024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2fb20095-5a0f-4b88-9088-62ebe21d0c29 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 Sep 01 07:20:39.669652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 406/823] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:39.705333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:39.707420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:39.713696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:39.714167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:39.714595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:39.715265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:39.715707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:39.716121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:39.744599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6ccad9e-6ec5-4947-a3fb-5937a6cea360 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043168 Sep 01 07:20:39.745778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 418/824] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:40.567397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:40.569558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:40.575414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:40.575895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:40.576332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:40.577017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:40.577497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:40.577919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:40.607393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ab4ba4e-b972-415d-95a0-1e2ebf5e9018 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043944 Sep 01 07:20:40.607933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 407/825] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:40.681038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:40.683230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:40.689166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:40.689652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:40.690079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:40.690795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:40.691238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:40.691658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:40.720518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1b336f9-96fa-47e0-a987-411761a8ddb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Sep 01 07:20:40.721142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 419/826] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:40.757132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:40.759293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:40.766069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:40.766546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:40.766975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:40.767885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:40.768089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:40.768516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:40.798541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-45a564e7-beb8-4c4a-b027-0c975c18ff79 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 Sep 01 07:20:40.799098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 408/827] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:41.619653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:41.621792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:41.627743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:41.628236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:41.628647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:41.629353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:41.629799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:41.630213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:41.659681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89d8a237-dce6-490e-bd49-52bf9943db49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044018 Sep 01 07:20:41.660217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 420/828] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:41.732463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:41.734661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:41.740461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:41.740917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:41.741387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:41.742072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:41.742523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:41.742942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:41.772229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b695d790-d1b6-4616-9450-90e93c148207 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 Sep 01 07:20:41.772803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 409/829] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:41.809978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:41.812093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:41.818398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:41.818871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:41.819302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:41.819986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:41.820433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:41.820855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:41.850164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a3924b4-71e7-4e5b-bc08-6e267ed29545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Sep 01 07:20:41.850707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 421/830] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:42.672309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:42.674489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:42.680536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:42.681047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:42.681509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:42.682204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:42.682658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:42.683140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:42.712162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e59728c1-91c6-49c4-ae55-8691f5745d72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044299 Sep 01 07:20:42.712707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 410/831] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:42.785287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:42.787390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:42.793275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:42.794429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:42.794866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:42.795543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:42.796015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:42.796432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:42.821145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:42.826119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c990259-07ce-4269-807c-b0c661ed940f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044825 Sep 01 07:20:42.826665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 422/832] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:42.862793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:42.864962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:42.871344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:42.871833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:42.872278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:42.872996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:42.873487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:42.873914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:42.902476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f8ed0012-aabe-41d1-ab11-00c5685b8b37 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Sep 01 07:20:42.903504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 411/833] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:43.724523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:43.726703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:43.732686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:43.733194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:43.733624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:43.734297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:43.734739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:43.735155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:43.765241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f6fcf18-20d2-40ee-92d4-f3c145633e2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044637 Sep 01 07:20:43.765797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 423/834] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:43.837344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:43.839495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:43.845643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:43.846132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:43.846573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:43.847268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:43.847725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:43.848156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:43.878522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0ecac063-931b-491e-b70b-6de57d7bd912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Sep 01 07:20:43.879142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 412/835] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:43.914827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:43.916917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:43.923675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:43.924138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:43.924565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:43.925259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:43.925704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:43.926117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:43.956849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b054d5a-2a2a-4254-8991-f759d0136c29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Sep 01 07:20:43.957432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 424/836] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:44.776960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:44.779858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:44.785743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:44.786224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:44.786658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:44.787336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:44.787784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:44.788208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:44.816663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be1bcf0f-d22c-4776-b3af-52a70cfe21e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043635 Sep 01 07:20:44.817220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 413/837] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:44.891437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:44.893610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:44.899446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:44.899920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:44.900349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:44.901021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:44.901487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:44.901904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:44.930581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75572269-e29e-4fa1-b450-7735ccf9c983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Sep 01 07:20:44.931165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 425/838] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:44.969028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:44.971189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:44.977718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:44.978209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:44.978651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:44.979344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:44.979801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:44.980231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:45.009508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2be51861-4b36-43e8-b4d5-50096d3f66ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Sep 01 07:20:45.010286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 414/839] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:45.829046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:45.831157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:45.837020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:45.837519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:45.837944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:45.838610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:45.839050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:45.839461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:45.869240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1b83999-df0c-4bf1-b8ea-48be2fd6f550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044158 Sep 01 07:20:45.869797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 426/840] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:45.943101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:45.945367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:45.951550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:45.952031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:45.952471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:45.953183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:45.953649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:45.954080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:45.983937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-51f8c994-f586-498c-bc29-33e81a7acbfb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Sep 01 07:20:45.984585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 415/841] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:46.021744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:46.023790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:46.030928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:46.031180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:46.031610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:46.032282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:46.032918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:46.033179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:46.062340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54d34158-257a-48c3-a67b-6066dba4ce36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Sep 01 07:20:46.062878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 427/842] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:46.882049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:46.884165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:46.890815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:46.891286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:46.891718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:46.892402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:46.892853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:46.893303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:46.922080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2bfe7d90-2058-48f9-a3f4-3959e65db9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044120 Sep 01 07:20:46.922617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 416/843] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:46.995820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:46.997987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:47.003878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:47.004346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:47.004770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:47.005458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:47.005893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:47.006299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:47.035717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32aa4396-535f-486d-9c1c-cd5fccaf9d44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043837 Sep 01 07:20:47.036328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 428/844] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:47.074377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:47.077062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:47.083109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:47.083589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:47.084024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:47.084715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:47.085195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:47.085642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:47.115129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a608611f-60e1-4b7d-9296-184fdf0864cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Sep 01 07:20:47.115709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 417/845] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:47.934432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:47.937155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:47.943017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:47.943480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:47.943901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:47.944567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:47.945003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:47.945450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:47.973841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-262d1501-8549-4279-ab36-840db473d7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043367 Sep 01 07:20:47.974372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 429/846] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:20:48.048533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:48.050725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:48.056529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:48.057005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:48.057463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:48.058143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:48.058590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:48.059009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:48.072661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:48.088329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-501fa251-3d8d-4497-864e-d88a6f2f9f44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044396 Sep 01 07:20:48.089610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 418/847] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:48.127086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:48.129257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:48.135595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:48.136064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:48.136488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:48.137457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:48.137901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:48.138315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:48.170575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7eff42dd-bd36-41ee-bc20-c805838122a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047327 Sep 01 07:20:48.171121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 430/848] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:48.986219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:48.988263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:48.994166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:48.994649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:48.995089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:48.995772 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:48.996225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:48.996670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:49.025977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d6ef6d6-913e-4027-8eeb-14129e1bc80f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043847 Sep 01 07:20:49.026514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 419/849] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:49.100938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:49.103056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:49.109875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:49.110678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:49.111324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:49.112406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:49.113196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:49.113926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:49.145974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02b518af-2a7d-4a36-bf71-4ca03f484868 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049024 Sep 01 07:20:49.146577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 431/850] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:49.182511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:49.184627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:49.191533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:49.192016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:49.192456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:49.193157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:49.193614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:49.194040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:49.222212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07bd4901-bea9-4da3-ad14-0b241bf8a29a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Sep 01 07:20:49.222757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 420/851] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:50.038341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:50.040484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:50.046547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:50.047029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:50.047461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:50.048155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:50.048601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:50.049021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:50.077909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ecc2aa4-3d23-464e-9af7-8fab954564a2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043563 Sep 01 07:20:50.078454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 432/852] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:20:50.158337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:50.160453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:50.166307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:50.166784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:50.167214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:50.167894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:50.168341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:50.168759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:50.197262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9aac453b-83e5-4f0e-9f3f-9e47a41d33de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Sep 01 07:20:50.197860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 421/853] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:50.233405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:50.235661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:50.241928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:50.242406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:50.242839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:50.243516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:50.243962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:50.244382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:50.274430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1b750136-71c4-410f-a75a-fd4034e900b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044923 Sep 01 07:20:50.274967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 433/854] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:51.090160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:51.092848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:51.098824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:51.099308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:51.099748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:51.100433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:51.100886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:51.101339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:51.131546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a821010b-e552-4ab5-b8f1-72b19c4b4d75 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045298 Sep 01 07:20:51.132114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 422/855] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:51.209494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:51.211590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:51.217449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:51.217923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:51.218353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:51.219021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:51.219465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:51.219880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:51.249185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88f4df8f-d23f-4c10-a97f-3df17b65bae5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Sep 01 07:20:51.249795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 434/856] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:51.286529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:51.288648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:51.295701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:51.296186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:51.296628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:51.297383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:51.297846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:51.298295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:51.327340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-20025efc-4be3-4573-b07d-eb8214b67388 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 01 07:20:51.327893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 423/857] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:52.144110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:52.146295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:52.152215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:52.152691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:52.153200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:52.153830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:52.154277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:52.154696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:52.183314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-77998149-2a74-4ada-a25e-2437b3d2033f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043242 Sep 01 07:20:52.183847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 435/858] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:52.261203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:52.263610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:52.269410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:52.269888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:52.270318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:52.270990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:52.271435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:52.271879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:52.300254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-482404d6-c9a1-4569-9428-5b3484c94013 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042998 Sep 01 07:20:52.300827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 424/859] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:52.339846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:52.341990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:52.348369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:52.348840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:52.349311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:52.349989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:52.350431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:52.350848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:52.380042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f36bcecb-eef0-406c-8d9d-71a7712401a6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Sep 01 07:20:52.380586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 436/860] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:53.195969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:53.198148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:53.204675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:53.205185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:53.205620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:53.206299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:53.206748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:53.207194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:53.236186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-11531b1a-0e5c-49e5-b460-cffa487a5264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044231 Sep 01 07:20:53.236742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 425/861] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:53.312256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:53.314374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:53.320260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:53.320729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:53.321186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:53.321863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:53.322304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:53.322719 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:53.352219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d5e47e1-0310-498c-be05-d12c722fa85d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Sep 01 07:20:53.352856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 437/862] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:53.392721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:53.394909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:53.401480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:53.401963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:53.402400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:53.403090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:53.403560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:53.403991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:53.432212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68963462-5147-467c-841e-a81a017b6ce9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Sep 01 07:20:53.432753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 426/863] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:54.248390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:54.250523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:54.257206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:54.257693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:54.258126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:54.258837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:54.259283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:54.259707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:54.289540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a4bbf74-a376-4cfb-8f5d-726484f823ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045065 Sep 01 07:20:54.290075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 438/864] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:54.364439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:54.366581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:54.372389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:54.372870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:54.373348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:54.374033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:54.374487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:54.374909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:54.404375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d8d17c52-654e-4f97-a7c2-1e72a9369e7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Sep 01 07:20:54.404993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 427/865] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:54.445285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:54.447531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:54.458022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:54.458625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:54.459109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:54.460026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:54.462505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:54.462946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:54.477967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:54.493799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6bc8d43-f1d9-4623-9a24-0ffe717b7a4d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052563 Sep 01 07:20:54.494350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 439/866] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:55.302665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:55.304873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:55.311413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:55.311897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:55.312340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:55.313033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:55.313515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:55.313945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:55.343645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55ad2df7-0e66-4756-a84c-e121c21e83a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045020 Sep 01 07:20:55.344199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 428/867] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:55.474460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:55.476563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:55.483793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:55.484264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:55.484691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:55.485389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:55.485835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:55.486253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:55.505867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:55.508354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:55.514752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e195a4b8-f58a-4f2d-b480-84dc0955abcd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044223 Sep 01 07:20:55.515498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 440/868] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:55.515640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:55.516120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:55.516571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:55.517304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:55.517765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:55.518196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:55.548029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c463bd51-f907-4bb4-b704-09c0c8905463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046086 Sep 01 07:20:55.548511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 429/869] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:56.355804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:56.357963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:56.363793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:56.364261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:56.364689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:56.365382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:56.365824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:56.366240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:56.395607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c1246b7-2374-455d-8d0d-fcfbd9a0b43e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043746 Sep 01 07:20:56.396146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 441/870] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:56.525857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:56.527983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:56.534972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:56.535444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:56.535874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:56.536547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:56.536994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:56.537442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:56.560601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:56.562746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:56.567449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c5749693-a5a7-410e-abf2-f5bf0539d3bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Sep 01 07:20:56.568005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 430/871] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:56.569079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:56.569607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:56.570039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:56.570722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:56.571166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:56.571585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:56.600222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f01d505-ab36-4d6a-a00f-bf84fb0b3335 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Sep 01 07:20:56.600760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 442/872] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:20:57.408364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:57.410514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:57.416312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:57.416784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:57.417257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:57.417932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:57.418386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:57.418803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:57.447091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac111050-2c85-449c-b335-caf75627fd79 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043276 Sep 01 07:20:57.447561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 431/873] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:57.579942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:57.582293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:57.588925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:57.589459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:57.589910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:57.590642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:57.591723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:57.592145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:57.611843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:57.614046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:57.620282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:57.620431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6cbd55c1-7d03-42b0-8dcb-4fb98769573b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044833 Sep 01 07:20:57.620763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:57.621031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 443/874] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:57.621224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:57.621914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:57.622363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:57.622784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:57.652225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-70969385-7c4e-4e5c-baaa-2e40405bf1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Sep 01 07:20:57.652761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 432/875] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:20:58.459536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:58.461706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:58.468066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:58.468540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:58.468972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:58.469683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:58.470138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:58.470552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:58.500632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12a26281-b053-4390-bd10-d42606f0b372 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045059 Sep 01 07:20:58.501198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 444/876] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:58.632187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:58.634351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:58.641182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:58.641670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:58.642109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:58.642800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:58.643283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:58.643710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:58.665001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:58.667157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:58.673377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8a48fc3-984b-4b00-b225-db3c0639a427 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Sep 01 07:20:58.673939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 433/877] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:58.674154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:58.674633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:58.675059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:58.675735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:58.676174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:58.676584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:58.709472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b099c0f-b48e-413d-9910-56db620b7843 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048251 Sep 01 07:20:58.710029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 445/878] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:20:59.513551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:59.515786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:59.521672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:59.522155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:59.522591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:59.523280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:59.523734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:59.524162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:59.552774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-41cf103b-f584-4968-85d3-2f71e3473172 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044038 Sep 01 07:20:59.553336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 434/879] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:20:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:20:59.686381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:59.688401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:59.694804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:59.695272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:59.695699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:59.696365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:59.696805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:59.697248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:59.721538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:20:59.723641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:20:59.725604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b7a4856-95e9-49a5-8493-5983545c6976 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Sep 01 07:20:59.726146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 446/880] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:20:59.730076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:59.730560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:59.730998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:59.732199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:20:59.732651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:20:59.733073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:20:59.736682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:20:59.762602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cd1d526e-7891-445d-8743-447683e08848 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Sep 01 07:20:59.763162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 435/881] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:20:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:00.564834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:00.567012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:00.573003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:00.573514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:00.573947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:00.574628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:00.575075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:00.575994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:00.604731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf24cfc4-6cf9-4ff0-950a-a5dce4614d4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043851 Sep 01 07:21:00.605302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 447/882] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:00.737146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:00.739289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:00.745609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:00.746084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:00.746517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:00.747698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:00.748148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:00.748567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:00.775034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:00.777162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:00.778009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dbfc7494-06ee-4b0c-8fae-8ce20b70a866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Sep 01 07:21:00.778561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 436/883] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:00.783304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:00.783782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:00.784212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:00.784895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:00.785372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:00.785793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:00.815245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65178506-d7a1-41a9-a1d8-8b84420fe426 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Sep 01 07:21:00.815836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 448/884] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:01.616768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:01.618961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:01.624829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:01.625351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:01.625797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:01.626486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:01.626942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:01.627370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:01.656308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b7746575-3539-4dc9-b319-f79e43168ba9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043492 Sep 01 07:21:01.656849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 437/885] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:01.790205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:01.792286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:01.798833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:01.799655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:01.800091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:01.800756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:01.801232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:01.801646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:01.827925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:01.830167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:01.830289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36dbfb35-fcea-481a-8881-805c0d5e0198 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Sep 01 07:21:01.830789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 449/886] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:01.836399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:01.836887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:01.837370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:01.838058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:01.838513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:01.838934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:01.867862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe30a45d-9a2a-4e89-9b40-261d7de11351 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Sep 01 07:21:01.868401 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 438/887] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:02.667985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:02.670596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:02.676372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:02.676841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:02.677307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:02.677983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:02.678419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:02.678831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:02.707358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0655bb20-9586-43cf-8dca-ce586c8cd2be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043404 Sep 01 07:21:02.707882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 450/888] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:02.842326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:02.844472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:02.850921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:02.851403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:02.851840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:02.852524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:02.852974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:02.853421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:02.879484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:02.881596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:02.882533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c55e1ac9-7ba4-45a6-ba3d-e4f10045b988 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Sep 01 07:21:02.883283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 439/889] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:02.888175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:02.888620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:02.889046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:02.889748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:02.890188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:02.890599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:02.918773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c5d1ce04-8b28-4521-b157-289460fa3bcf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043110 Sep 01 07:21:02.919746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 451/890] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:03.719328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:03.721475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:03.723345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=86 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:03.728770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:03.729293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:03.729735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:03.730428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:03.730884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:03.731311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:03.760459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d343026a-a303-4477-ab9e-af22e3c964d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045539 Sep 01 07:21:03.760955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 440/891] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:03.931453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:03.933607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:03.939818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:03.940300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:03.940740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:03.941454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:03.941908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:03.942333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:03.971989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78fe10cd-b797-4de4-93e1-61cb043a435f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Sep 01 07:21:03.972553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 441/892] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:04.000757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:04.002925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:04.008741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:04.009272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:04.009702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:04.010382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:04.010880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:04.011257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:04.039908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12237e00-d13f-4e43-bd4e-28340d81c69d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148986 Sep 01 07:21:04.040452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 452/893] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:04.773000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:04.775138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:04.781558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:04.782034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:04.782514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:04.783142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:04.783586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:04.784001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:04.813179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1167258-c0c3-4300-91e8-06cd0c6f37f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044168 Sep 01 07:21:04.813715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 442/894] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:04.983843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:04.986040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:04.992341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:04.992809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:04.993277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:04.993949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:04.994391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:04.994813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:05.023684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-553373bc-b553-465c-98e8-f58f1bcaa314 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 Sep 01 07:21:05.024271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 453/895] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:05.051408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:05.053456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:05.059821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:05.060377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:05.060811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:05.061523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:05.061973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:05.062391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:05.090628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4f265116-c9e2-4b14-887a-8ccecc7146be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Sep 01 07:21:05.091159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 443/896] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:05.825074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:05.827166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:05.832948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:05.833460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:05.833888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:05.834559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:05.835004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:05.835417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:05.863976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02a79060-8a49-45b7-af2c-92c2a749b3ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043003 Sep 01 07:21:05.864514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 454/897] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:06.036170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:06.038365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:06.044207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:06.045301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:06.045737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:06.046416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:06.046902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:06.047320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:06.075446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1be93556-8b42-4e46-a33c-d2b7b1fb3bdf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Sep 01 07:21:06.076098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 444/898] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:06.103320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:06.105433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:06.112170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:06.112637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:06.113063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:06.113877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:06.114315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:06.114725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:06.143222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9913c0bc-5b1f-4727-8be5-388b15881f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Sep 01 07:21:06.143761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 455/899] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:06.876434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:06.878520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:06.884389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:06.884869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:06.885351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:06.886031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:06.886474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:06.887145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:06.915702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26c4c19a-96db-4407-b29f-3476b8728c66 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Sep 01 07:21:06.916235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 445/900] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:07.087537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:07.089648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:07.091486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:07.096789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:07.097297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:07.097777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:07.098440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:07.098879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:07.099288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:07.102973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:07.129034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79491fbf-1319-421f-8f72-4a7f01998b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045390 Sep 01 07:21:07.129644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 456/901] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:07.155162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:07.157313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:07.163757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:07.164234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:07.164674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:07.165390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:07.165841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:07.166265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:07.196575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b14e3f77-536c-440b-9db0-0b2d056785e3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Sep 01 07:21:07.197139 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 446/902] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:07.928569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:07.930703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:07.937858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:07.938342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:07.938776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:07.939478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:07.939925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:07.940347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:07.970972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c29db005-ff36-4d0b-9bbb-73546b2d131c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046884 Sep 01 07:21:07.971529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 457/903] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:08.141951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:08.144089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:08.150208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:08.150700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:08.151141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:08.151841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:08.152299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:08.152724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:08.182384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9884490d-a5a1-4605-ac95-f5c06f0229b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Sep 01 07:21:08.183023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 447/904] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:08.209096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:08.211268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:08.217667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:08.218149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:08.218580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:08.219261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:08.219709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:08.220130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:08.249277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76dd4723-8623-4e12-89cf-222f18772139 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Sep 01 07:21:08.249819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 458/905] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:08.983892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:08.985982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:08.991822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:08.992297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:08.992737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:08.993453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:08.993903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:08.994328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:09.022871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e3dfea4-ee46-4090-8afe-c5781f4c6349 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043657 Sep 01 07:21:09.023432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 448/906] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:09.194727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:09.196808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:09.202895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:09.203363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:09.203785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:09.204452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:09.204889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:09.205334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:09.234778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fbc6d7e9-fdbc-430b-bc1e-c2e10b828bb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Sep 01 07:21:09.235376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 459/907] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:09.261450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:09.263836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:09.270600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:09.271085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:09.271527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:09.272220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:09.272678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:09.273106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:09.301758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-89aa9f87-29c5-439b-8445-e531f499da94 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Sep 01 07:21:09.302299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 449/908] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:10.034901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:10.037017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:10.043046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:10.043511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:10.043934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:10.044595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:10.045030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:10.046066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:10.074777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3a146f6-16b2-4838-a601-ca149c604be3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043978 Sep 01 07:21:10.075309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 460/909] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:10.246795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:10.249500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:10.255619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:10.256095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:10.256541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:10.257243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:10.257695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:10.258115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:10.287046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-179aa1b6-51e8-4c3f-be52-553905a6b5fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Sep 01 07:21:10.287655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 450/910] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:10.314279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:10.316378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:10.322613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:10.323093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:10.323526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:10.324203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:10.324649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:10.325067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:10.354184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aef8a1cc-3443-4fc6-b653-8ea2463eef07 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044357 Sep 01 07:21:10.354748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 461/911] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:11.086711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:11.088871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:11.095423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:11.095898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:11.096331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:11.097008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:11.097500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:11.097908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:11.121696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:11.127340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2fe6c2c-94d9-4c7f-a2bb-a4c6a6293f56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044618 Sep 01 07:21:11.127882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 451/912] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:11.299174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:11.301331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:11.307212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:11.307683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:11.308107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:11.308780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:11.309248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:11.309673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:11.339842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-105dcff3-6af7-4dee-b01d-ee08d9d8cc25 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Sep 01 07:21:11.340471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 462/913] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:11.366952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:11.369091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:11.376194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:11.376676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:11.377109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:11.377817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:11.378263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:11.378682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:11.408003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f8b94c47-89eb-4ede-bbcd-0701060cbbbc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Sep 01 07:21:11.408553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 452/914] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:12.139891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:12.142031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:12.147867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:12.148344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:12.148772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:12.149477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:12.149923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:12.150340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:12.178518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d44cade9-b80e-47ce-ae68-cceb6b0f58c3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043523 Sep 01 07:21:12.179051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 463/915] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:12.351088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:12.353226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:12.359572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:12.360042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:12.360476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:12.361175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:12.361623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:12.362043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:12.393255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-205385e7-1c92-4d90-b124-5eea3144f5d3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Sep 01 07:21:12.393867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 453/916] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:12.419774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:12.422669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:12.429160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:12.429616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:12.430041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:12.430710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:12.431178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:12.431588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:12.460736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef94cb8e-e093-4906-979f-78f336d15a06 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Sep 01 07:21:12.461309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 464/917] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:13.190731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:13.192857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:13.198784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:13.199270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:13.199714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:13.200402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:13.200858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:13.201324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:13.234420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9274c30-2aa2-4c6b-94dd-2cb89706f277 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047640 Sep 01 07:21:13.234982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 454/918] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:13.407506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:13.409658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:13.415861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:13.416324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:13.416745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:13.417448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:13.417884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:13.418293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:13.447805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0e9a2e8-f463-4d1d-975a-a286bdf8f98d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044810 Sep 01 07:21:13.448424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 465/919] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:13.472754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:13.474904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:13.483682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:13.484196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:13.484631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:13.485504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:13.486095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:13.486524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:13.517703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a4f166d-c48a-4bbb-a21d-cd25e2be90d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048833 Sep 01 07:21:13.518251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 455/920] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:14.246599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:14.248750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:14.254728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:14.255200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:14.255631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:14.256336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:14.256778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:14.257219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:14.286340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0156c5ab-cd95-440e-9816-67a354e8d3a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043710 Sep 01 07:21:14.286880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 466/921] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:14.461536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:14.463717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:14.470059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:14.470541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:14.470975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:14.471662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:14.472125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:14.472544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:14.501959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d6dd5f2d-b5ff-4110-9661-ae5ccc57eea5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045149 Sep 01 07:21:14.502555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 456/922] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:14.530733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:14.533466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:14.539763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:14.540237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:14.540655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:14.541357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:14.541810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:14.542210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:14.570619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7735b73-046c-43ff-8086-faa1ad2b4a74 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Sep 01 07:21:14.571169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 467/923] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:15.299039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:15.301213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:15.307151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:15.307633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:15.308071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:15.308754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:15.309243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:15.309669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:15.340944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8fc2ef22-c7c5-4268-a896-18ca2cdaa18f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046325 Sep 01 07:21:15.341612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 457/924] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:15.514526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:15.516681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:15.522692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:15.523173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:15.523608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:15.524300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:15.524739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:15.525187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:15.553949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe127549-f52e-4080-bfc7-d02a6105e27f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Sep 01 07:21:15.554559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 468/925] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:15.581681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:15.583805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:15.590500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:15.590983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:15.591422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:15.592131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:15.592590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:15.593013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:15.625215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-52338818-a467-43b0-88a6-e98b1bf7ed83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047445 Sep 01 07:21:15.625779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 458/926] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:16.353644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:16.355782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:16.361675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:16.362148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:16.362600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:16.363276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:16.363720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:16.364137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:16.393252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0eb97571-5b79-475b-a226-abcdf06fd498 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043499 Sep 01 07:21:16.393796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 469/927] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:16.565345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:16.567480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:16.573608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:16.574083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:16.574515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:16.575192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:16.575643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:16.576061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:16.604751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-75dea7bd-ffe0-4dca-86ac-652d3e3dfba4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Sep 01 07:21:16.605335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 459/928] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:16.637773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:16.639876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:16.646165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:16.646636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:16.647065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:16.647737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:16.648221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:16.648637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:16.678465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4398ed84-8a3e-4430-a640-1fede38fac75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Sep 01 07:21:16.679008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 470/929] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:17.405407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:17.407590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:17.413803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:17.414288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:17.414730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:17.415420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:17.415871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:17.416293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:17.446184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d4ed3dfe-859a-4601-9708-fe46341ec6aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044704 Sep 01 07:21:17.446751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 460/930] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:17.617444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:17.619585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:17.626453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:17.626891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:17.627319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:17.628043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:17.628529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:17.628946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:17.657641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5453689-daaa-4491-a8f5-eb3ab74af3f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Sep 01 07:21:17.658229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 471/931] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:17.695421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:17.697676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:17.703975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:17.704563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:17.705084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:17.705802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:17.706238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:17.706656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:17.735116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f462166-4b88-46d8-8421-d5587a56b04c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043647 Sep 01 07:21:17.735665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 461/932] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:18.458914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:18.460944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:18.467732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:18.468203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:18.468621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:18.469325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:18.469763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:18.470172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:18.494344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:18.499726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-885fb4fd-2b55-4298-a334-b6d059cb95e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044826 Sep 01 07:21:18.500275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 472/933] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:18.669458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:18.671617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:18.677508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:18.677992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:18.678432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:18.679117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:18.679569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:18.679994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:18.711290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-628bb730-ab88-4713-bd35-72d01fb092c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 01 07:21:18.712229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 462/934] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:18.747553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:18.750243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:18.756474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:18.756945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:18.757405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:18.758079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:18.758514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:18.758922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:18.788197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7ba02b6-645a-4ed9-9563-909568278510 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Sep 01 07:21:18.788737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 473/935] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:19.511970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:19.514501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:19.520310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:19.520785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:19.521266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:19.521948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:19.522397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:19.522815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:19.551975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-836f7e54-4261-48cf-b854-978ea0252c98 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044043 Sep 01 07:21:19.552505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 463/936] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:19.724274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:19.726457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:19.732267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:19.733319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:19.733754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:19.734428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:19.734870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:19.735285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:19.764899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1896a3f6-e22f-41b4-910d-ca5f1a4d859b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Sep 01 07:21:19.765513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 474/937] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:19.800166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:19.802377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:19.808674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:19.809182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:19.809621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:19.810311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:19.810763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:19.811193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:19.839465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c6dc9f75-eb78-4d02-b5da-b726f25b8f8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043203 Sep 01 07:21:19.840005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 464/938] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:20.564776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:20.566936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:20.572993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:20.573492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:20.573961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:20.574579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:20.575017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:20.575428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:20.603689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d109cfde-bbd2-40c8-a439-2ab54c71b345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043470 Sep 01 07:21:20.604223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 475/939] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:20.776493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:20.778629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:20.784543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:20.785023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:20.785491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:20.786179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:20.786634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:20.787058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:20.817534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ad620bf7-f87f-436f-927b-a38c052613ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Sep 01 07:21:20.818128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 465/940] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:20.851346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:20.853483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:20.860151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:20.860616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:20.861037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:20.861721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:20.862165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:20.862579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:20.890979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-062e931c-dcc1-4ffa-b53e-cbbc6486f639 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Sep 01 07:21:20.891511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 476/941] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:21.616062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:21.618213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:21.624601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:21.625077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:21.625535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:21.626220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:21.626672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:21.627094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:21.656565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-89d06b48-ceee-4ad2-940c-3fb286bdf9ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044545 Sep 01 07:21:21.657095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 466/942] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:21.829354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:21.831480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:21.837421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:21.837900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:21.838335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:21.839019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:21.839466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:21.839888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:21.869928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ed66530-d327-4ca7-84ed-2dc458e49042 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Sep 01 07:21:21.870541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 477/943] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:21.902911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:21.905598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:21.911806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:21.912288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:21.912724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:21.913436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:21.913896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:21.914317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:21.942666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d68acd02-0924-447c-b811-19b236822aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Sep 01 07:21:21.943201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 467/944] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:22.668728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:22.670893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:22.676702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:22.677196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:22.677622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:22.678288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:22.678726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:22.679137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:22.708998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb9c34a1-f04f-4f51-875c-b89d670a7a8d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044200 Sep 01 07:21:22.709559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 478/945] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:22.882098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:22.884260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:22.890461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:22.890939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:22.891376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:22.892061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:22.892515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:22.892939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:22.906232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:22.922782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0c5236d-c8a5-4a8b-9b36-380441e4e031 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Sep 01 07:21:22.923330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 468/946] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:22.954086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:22.956205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:22.962457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:22.962922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:22.963346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:22.964011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:22.964445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:22.964862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:22.993027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ceadaed5-41df-4d16-b9b8-399c4d22bd50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042827 Sep 01 07:21:22.993592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 479/947] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:23.721341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:23.723385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:23.729198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:23.729681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:23.730116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:23.730802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:23.731254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:23.731677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:23.761176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e665a50a-fd45-4c32-abba-32c52a9286fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043883 Sep 01 07:21:23.761739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 469/948] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:23.934893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:23.937054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:23.942917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:23.943384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:23.943803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:23.944469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:23.944909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:23.945358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:23.974147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-49c7c18a-db19-4290-9739-591a0fbb2ef1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Sep 01 07:21:23.974736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 480/949] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:24.005088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:24.007227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:24.013780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:24.014257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:24.014693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:24.015376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:24.015831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:24.016255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:24.044471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a961ee97-fc92-4be5-9c9f-3f90b3fcc808 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 Sep 01 07:21:24.045019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 470/950] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:24.773858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:24.775959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:24.781917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:24.782389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:24.782816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:24.783492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:24.783941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:24.784360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:24.812987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ebce426-a10c-47e5-96cd-65eb96df7a45 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043070 Sep 01 07:21:24.813557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 481/951] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:24.986354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:24.988506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:24.994408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:24.994887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:24.995325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:24.996011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:24.996470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:24.996893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:25.026617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b249a4be-5082-4cb9-ae8e-e8b69efb9908 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Sep 01 07:21:25.027222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 471/952] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:25.057255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:25.059354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:25.066185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:25.066659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:25.067091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:25.067769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:25.068212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:25.068631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:25.096967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7a71dbb-b617-463f-bedb-b4758d74b963 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Sep 01 07:21:25.097552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 482/953] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:25.825189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:25.827804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:25.833801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:25.834285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:25.834720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:25.835407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:25.835859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:25.836283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:25.864940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d72da37b-dccf-463d-9aed-e81b1154638d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043759 Sep 01 07:21:25.865508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 472/954] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:26.038880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:26.041004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:26.046836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:26.047301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:26.047727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:26.048392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:26.048833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:26.049281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:26.077884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5cc7025f-c62b-4432-bbf0-d29b9558497c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042976 Sep 01 07:21:26.078461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 483/955] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:26.108946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:26.111183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:26.117049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:26.117566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:26.118000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:26.118695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:26.119148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:26.119576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:26.149309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3f1a180a-c68d-42f9-a5ef-e6b87553624e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Sep 01 07:21:26.149867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 473/956] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:26.877877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:26.879985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:26.885939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:26.886415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:26.886842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:26.887770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:26.888221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:26.888642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:26.918130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a3b9cf29-20e0-4d98-b1a5-4b17d3b93a24 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044997 Sep 01 07:21:26.918670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 484/957] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:27.089845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:27.092461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:27.098720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:27.099201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:27.099638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:27.100320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:27.100775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:27.101223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:27.130072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e100e765-1d0d-4d93-b11a-6c8d7c5da8b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Sep 01 07:21:27.130659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 474/958] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:27.161608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:27.165255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:27.172662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:27.173154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:27.173839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:27.174525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:27.174963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:27.175375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:27.205807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1a19890a-7897-4776-ab1e-38bd3740602f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048032 Sep 01 07:21:27.206357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 485/959] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:27.931108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:27.933300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:27.939879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:27.940358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:27.940793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:27.941523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:27.941978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:27.942402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:27.971293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d43a5259-c313-4d8d-8e0a-ad5e0bbdfbf2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044179 Sep 01 07:21:27.971965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 475/960] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:28.142270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:28.144460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:28.150352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:28.150825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:28.151256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:28.151926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:28.152371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:28.152789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:28.182511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-316aa33d-8e49-47a8-9574-7f9a67156fb2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Sep 01 07:21:28.183148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 486/961] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:28.218304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:28.220481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:28.227228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:28.227745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:28.228181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:28.228866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:28.229339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:28.229755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:28.259088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5a8be2a-b061-49da-8563-4627a600674f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Sep 01 07:21:28.259641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 476/962] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:28.983729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:28.986055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:28.991912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:28.992394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:28.992827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:28.993533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:28.993979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:28.994398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:29.023537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1637c19-efb7-4fca-bd6f-9800f0789e03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044101 Sep 01 07:21:29.024082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 487/963] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:29.195573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:29.198021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:29.204699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:29.205217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:29.205658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:29.206347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:29.206829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:29.207256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:29.236404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-895731c9-d0a5-448f-90b4-0b7ecc37d3be tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044781 Sep 01 07:21:29.236983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 477/964] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:29.271599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:29.273987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:29.280244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:29.280712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:29.281154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:29.281828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:29.282269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:29.282688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:29.311239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e0f4a4b-d26c-4c39-8b08-7063f28e013c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043049 Sep 01 07:21:29.311775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 488/965] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:30.035682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:30.037880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:30.049738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:30.050224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:30.050657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:30.051352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:30.051805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:30.052255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:30.081323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-070c9145-3e3f-4c4f-ae98-c76e167760de tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049653 Sep 01 07:21:30.081871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 478/966] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:30.248164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:30.250690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:30.257366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:30.257841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:30.258298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:30.259014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:30.259459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:30.259875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:30.275273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:30.292622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e26a20c5-6c12-4838-a904-427740150f62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048344 Sep 01 07:21:30.293129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 489/967] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:30.323046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:30.325199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:30.332041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:30.332526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:30.332967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:30.333699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:30.334145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:30.334571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:30.364697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5e7c043b-b6ae-44e8-a9d8-8d4b538c7cd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Sep 01 07:21:30.365300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 479/968] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:31.094205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:31.096310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:31.102285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:31.102752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:31.103179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:31.103845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:31.104284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:31.104705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:31.132893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f989266-c5de-4bd7-bf58-f0db84208f09 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043341 Sep 01 07:21:31.133451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 490/969] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:31.305426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:31.307613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:31.313560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:31.314045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:31.314483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:31.315174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:31.315630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:31.316056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:31.345934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba46ce4a-d2b3-43f8-b68a-2041c4360bf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044424 Sep 01 07:21:31.346557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 480/970] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:31.377720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:31.379812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:31.386208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:31.386676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:31.387101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:31.388027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:31.388466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:31.388878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:31.417284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c326ae0-4e19-4feb-a322-8f36bf199d55 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Sep 01 07:21:31.417823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 491/971] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:32.146014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:32.148205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:32.154148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:32.154631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:32.155586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:32.156273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:32.156727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:32.157170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:32.186114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fa4e381-6ccb-41e7-8d41-8e14d291bd23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044074 Sep 01 07:21:32.187172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 481/972] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:32.357694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:32.359788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:32.365660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:32.366125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:32.366544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:32.367209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:32.367643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:32.368052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:32.398300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5405a31d-bea1-4fe2-9a80-0ac02ee95590 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Sep 01 07:21:32.398842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 492/973] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:32.428694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:32.430844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:32.437589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:32.438073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:32.438512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:32.439193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:32.439646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:32.440067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:32.468776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-46ccdab4-ce07-4213-bccb-a28b009b6e39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Sep 01 07:21:32.469354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 482/974] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:33.198797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:33.200951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:33.206868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:33.207339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:33.207763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:33.208432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:33.208868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:33.209323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:33.238644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c3026fc-2ddc-4cf0-82ab-784f8ce93c3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043767 Sep 01 07:21:33.239188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 493/975] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:33.410210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:33.412331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:33.418213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:33.418688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:33.419119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:33.419801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:33.420249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:33.420693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:33.448890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56c5deb7-d1ce-4a06-a824-bf158c3e3eb6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Sep 01 07:21:33.449508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 483/976] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:33.479643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:33.481778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:33.487986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:33.488454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:33.488880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:33.489582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:33.490019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:33.490431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:33.519165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b49572d-03d3-4b74-8464-88b3a0711ea1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043350 Sep 01 07:21:33.519698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 494/977] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:34.251492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:34.253652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:34.255504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:34.260614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:34.261091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:34.261548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:34.262233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:34.262953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:34.263370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:34.291519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e1d1857-6359-4d1d-a0bd-6c22eb75086e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044688 Sep 01 07:21:34.292056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 484/978] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:34.462097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:34.464297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:34.470955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:34.471424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:34.471846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:34.472511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:34.472948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:34.473387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:34.502683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7554fd0d-be3f-4ba6-8724-8aa8de95e897 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Sep 01 07:21:34.503263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 495/979] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:34.531709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:34.533856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:34.540334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:34.540829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:34.541281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:34.541979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:34.542430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:34.542850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:34.547172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:34.572421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d041750-3e1d-413d-9144-298999f754cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Sep 01 07:21:34.572967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 485/980] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:35.304471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:35.306609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:35.312943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:35.313440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:35.313867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:35.314533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:35.314971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:35.315379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:35.344721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f92ce94-2642-4a67-80ff-be87f7317f19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044424 Sep 01 07:21:35.345281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 496/981] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:35.515780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:35.517974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:35.523962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:35.524444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:35.524884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:35.525621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:35.526081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:35.526506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:35.555301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be91df18-a4c0-406a-9470-10fd67dd163a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Sep 01 07:21:35.555875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 486/982] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:35.583684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:35.585900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:35.592113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:35.592619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:35.593045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:35.593735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:35.594171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:35.594581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:35.622843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58ab84b9-8624-4366-9024-9d1eee9d2569 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043039 Sep 01 07:21:35.623380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 497/983] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:36.357258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:36.359421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:36.365350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:36.365854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:36.366296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:36.366983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:36.367435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:36.367858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:36.397454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-617262d5-589d-40b4-9486-b9bdfe236b12 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044196 Sep 01 07:21:36.398197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 487/984] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:36.567142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:36.569250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:36.575066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:36.575532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:36.575957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:36.576623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:36.577627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:36.578046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:36.606735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-652ef492-7d74-4ee0-bb02-927a4add8ddd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Sep 01 07:21:36.607320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 498/985] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:36.634944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:36.637111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:36.644180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:36.644661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:36.645096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:36.645796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:36.646247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:36.646670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:36.674418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3460fb01-0d2a-4b6f-8993-387d2395c11c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043412 Sep 01 07:21:36.674961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 488/986] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:37.410487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:37.412578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:37.414580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:37.419910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:37.420379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:37.421421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:37.422091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:37.422526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:37.422967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:37.452680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-683e5395-d6c3-498a-885a-4c66a5678f81 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046091 Sep 01 07:21:37.453272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 499/987] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:21:37.618768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:37.620884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:37.627273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:37.627752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:37.628185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:37.628864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:37.629365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:37.629786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:37.658760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-afed8bfd-c567-4946-8751-c1b990359d62 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Sep 01 07:21:37.659362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 489/988] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:37.686864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:37.688898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:37.695121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:37.695605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:37.696015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:37.696685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:37.697168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:37.697554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:37.725970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-50971e82-e22c-439f-832f-0a55edbf43a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043574 Sep 01 07:21:37.726509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 500/989] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:38.463733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:38.465886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:38.472251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:38.472730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:38.473193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:38.473887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:38.474340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:38.474761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:38.504223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-41cb1bbc-5ae6-4d1a-99c0-b26d67a126d9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044377 Sep 01 07:21:38.504762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 490/990] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:38.671425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:38.673549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:38.679397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:38.679869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:38.680299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:38.680970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:38.681446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:38.681864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:38.710711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8ef1dc4-9ab8-47eb-a668-330ed9e8b358 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043193 Sep 01 07:21:38.711279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 501/991] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:38.737905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:38.740106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:38.746339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:38.746818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:38.747256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:38.747944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:38.748397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:38.748826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:38.778108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-abc48394-e79d-45bc-9c22-163469c4658d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Sep 01 07:21:38.778659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 491/992] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:39.516057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:39.518205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:39.524065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:39.524534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:39.524962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:39.525673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:39.526121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:39.526539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:39.555346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb2632e3-d071-4afb-82f7-985de7a6553e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043459 Sep 01 07:21:39.555884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 502/993] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:39.723230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:39.725351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:39.731205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:39.731690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:39.732128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:39.732821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:39.733872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:39.734299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:39.763602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c36f183b-5a82-4d3a-8f4f-fb4ae550908c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Sep 01 07:21:39.764291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 492/994] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:39.790755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:39.792876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:39.800061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:39.800593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:39.801028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:39.801764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:39.802209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:39.802631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:39.830917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-594c6942-b47d-489e-a304-d3451c39ef11 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Sep 01 07:21:39.831466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 503/995] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:40.567848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:40.570043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:40.575970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:40.576456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:40.577566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:40.578261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:40.578721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:40.579155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:40.607463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb4f86a7-9218-450e-9576-5d3d095c9e6a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043509 Sep 01 07:21:40.607952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 493/996] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:40.775622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:40.777769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:40.783596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:40.784059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:40.784479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:40.785174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:40.785624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:40.786031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:40.815566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-087473d2-a438-4d23-9428-5dca194409c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Sep 01 07:21:40.816190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 504/997] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:40.842918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:40.845033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:40.851349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:40.851836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:40.852279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:40.852974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:40.853470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:40.853898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:40.882921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-918d6dd0-b1e0-48f9-bfa9-30354dfc4edd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Sep 01 07:21:40.883407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 494/998] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:41.619413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:41.621543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:41.627546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:41.628013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:41.628441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:41.629136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:41.629585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:41.629998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:41.659731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15bcc0e9-d3dc-4a8e-986b-219ff176e64c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044290 Sep 01 07:21:41.660271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 505/999] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:41.828477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:41.830576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:41.836438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:41.836917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:41.837383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:41.838072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:41.838524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:41.838945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:41.868694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8fad33c8-3caf-41d4-8cba-a4a458c022fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044841 Sep 01 07:21:41.869359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 495/1000] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:41.896027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:41.898201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:41.904468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:41.904945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:41.905408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:41.906085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:41.906527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:41.906944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:41.910458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:41.936511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce88673d-9966-440e-8a20-46e4e3bf9a92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Sep 01 07:21:41.937063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 506/1001] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:42.671751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:42.673911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:42.679842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:42.680329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:42.680770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:42.681486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:42.681953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:42.682381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:42.711643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4722eb4f-090b-4a25-8c5d-145c0d0987ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043827 Sep 01 07:21:42.712191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 496/1002] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:42.880515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:42.882577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:42.888748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:42.889805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:42.890246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:42.890923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:42.891366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:42.891781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:42.920173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-877dc4d3-475f-470b-9fce-7e2961cdd0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Sep 01 07:21:42.921088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 507/1003] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:42.947661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:42.949806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:42.956728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:42.957252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:42.957689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:42.958377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:42.958831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:42.959359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:42.987238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7fbf6bc6-26db-450b-bd6d-b08caff63a0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043291 Sep 01 07:21:42.987799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 497/1004] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:43.724608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:43.726743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:43.732586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:43.733692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:43.734126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:43.734809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:43.735257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:43.735679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:43.766115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93c280d3-a8e5-40e9-9a66-1838c12d2c49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045641 Sep 01 07:21:43.766676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 508/1005] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:43.932296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:43.934413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:43.940969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:43.941510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:43.941946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:43.942633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:43.943085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:43.943509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:43.971656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83eeeccd-32f1-495a-84d2-aa291a8592fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043387 Sep 01 07:21:43.972256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 498/1006] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:43.999803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:44.001930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:44.008145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:44.008616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:44.009045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:44.009744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:44.010187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:44.010603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:44.041398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b607fa77-af88-410b-a2cf-bd60d06d3b8b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046036 Sep 01 07:21:44.041957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 509/1007] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:44.778309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:44.781012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:44.796557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:44.797054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:44.797528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:44.798228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:44.798710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:44.799159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:44.828511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fb53c6a5-fa4a-43c4-848f-ea66e914f48f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054128 Sep 01 07:21:44.829071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 499/1008] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:44.984170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:44.986301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:44.992183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:44.992651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:44.993075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:44.993765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:44.994202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:44.994616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:45.023308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-792b4d92-3740-4fcf-8224-e8bcf2b7f3ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 Sep 01 07:21:45.023889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 510/1009] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:45.054039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:45.056154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:45.062520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:45.063014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:45.063451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:45.064133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:45.064586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:45.065011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:45.093348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e498ae57-7a8c-4c48-af8a-6d40a5f2ed39 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043184 Sep 01 07:21:45.093891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 500/1010] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:45.841312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:45.844043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:45.849943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:45.850409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:45.850845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:45.851499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:45.851935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:45.852346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:45.880894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21cdc197-e133-4cc5-be47-59c2d4bf1137 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043817 Sep 01 07:21:45.881467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 511/1011] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:46.035938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:46.038131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:46.044026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:46.044511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:46.044959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:46.045796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:46.046587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:46.047347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:46.072858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:46.079364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7d490b4-7179-4ac1-b21d-91eaa7e7c2fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047373 Sep 01 07:21:46.079918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 501/1012] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:46.105496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:46.107684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:46.114071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:46.114545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:46.114976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:46.115655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:46.116099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:46.116515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:46.145290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28c20322-ad51-4917-bcd3-81f1e1461f48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043737 Sep 01 07:21:46.145904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 512/1013] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:46.893580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:46.895638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:46.901445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:46.901929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:46.902365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:46.903052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:46.903505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:46.903928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:46.935303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5289e7b4-40af-44b7-812f-41815dcd535a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045941 Sep 01 07:21:46.935842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 502/1014] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:47.091369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:47.093525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:47.099347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:47.099821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:47.100245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:47.100911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:47.101370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:47.101783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:47.130797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-98e76177-345c-418b-8f7c-9b824d735f39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 Sep 01 07:21:47.131384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 513/1015] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:47.157061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:47.159156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:47.165375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:47.165857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:47.166292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:47.166977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:47.167427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:47.167849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:47.196611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-213c1007-76f8-4e62-82e2-0b5dff04d53d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Sep 01 07:21:47.197177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 503/1016] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:47.948442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:47.950503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:47.956986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:47.957496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:47.957922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:47.958606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:47.959051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:47.959468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:47.987818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d9b95c42-dd01-4de8-bb4b-99c7bce6d6ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043420 Sep 01 07:21:47.988362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 514/1017] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:48.144214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:48.146359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:48.152146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:48.152623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:48.153056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:48.153761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:48.154208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:48.154625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:48.182538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25cd9880-5183-439d-86e3-4dece7f6e2c2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042306 Sep 01 07:21:48.183134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 504/1018] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:48.208492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:48.210660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:48.216910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:48.217441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:48.217870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:48.218546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:48.218988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:48.219403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:48.247265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28eca56d-1d78-46e5-8414-35468da86aef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042655 Sep 01 07:21:48.247802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 515/1019] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:48.999900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:49.002002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:49.007966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:49.008431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:49.008869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:49.009582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:49.010034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:49.010459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:49.040015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37ad72e5-f6b7-435d-99da-228f12423d9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044439 Sep 01 07:21:49.040553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 505/1020] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:49.194890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:49.197014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:49.203472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:49.203955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:49.204387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:49.205065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:49.205540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:49.205963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:49.234952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0ae6f8b-3b19-426f-a7fe-161ee9513cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Sep 01 07:21:49.235558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 516/1021] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:49.259182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:49.261303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:49.268350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:49.268822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:49.269286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:49.269969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:49.270417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:49.270836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:49.299150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-73c97026-fb19-471b-b891-d53f37d47319 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Sep 01 07:21:49.299712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 506/1022] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:50.052510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:50.054634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:50.060375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:50.060839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:50.061851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:50.062520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:50.062959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:50.063370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:50.091999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e401df1e-223e-46ff-ae4f-1d2c193d1a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043413 Sep 01 07:21:50.092607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 517/1023] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:50.246294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:50.248445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:50.254301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:50.254790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:50.255231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:50.255920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:50.256377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:50.256803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:50.285816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d40f2d19-69f4-4ffa-8fb0-168425db548e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043456 Sep 01 07:21:50.286450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 507/1024] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:50.311459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:50.313516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:50.319679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:50.320146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:50.320573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:50.321273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:50.321710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:50.322114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:50.351547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bdf04a6f-e28d-403d-8f86-757f48988498 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Sep 01 07:21:50.352100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 518/1025] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:51.104407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:51.106552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:51.112618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:51.113101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:51.113565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:51.114249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:51.114698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:51.115119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:51.144773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0d28deda-eb67-4db8-a48c-bd55981d5e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044300 Sep 01 07:21:51.145349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 508/1026] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:51.297503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:51.299598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:51.305500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:51.305974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:51.306403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:51.307077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:51.307520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:51.307939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:51.336777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04163962-ab7c-4acc-9a52-5636fdf0caec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Sep 01 07:21:51.337410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 519/1027] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:51.364404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:51.366473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:51.372660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:51.373158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:51.374224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:51.374900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:51.375353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:51.375766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:51.403687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6cf283a1-0245-4ce7-b08c-48e651427eba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Sep 01 07:21:51.404224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 509/1028] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:52.157728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:52.159867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:52.165862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:52.166337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:52.166767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:52.167443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:52.167886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:52.168307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:52.196497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e01815fd-bd85-4658-9efe-763ba1bd1be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043369 Sep 01 07:21:52.197028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 520/1029] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:52.349504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:52.351651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:52.357501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:52.357984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:52.358417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:52.359100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:52.359553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:52.359974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:52.388964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-45adce51-2ac6-43ff-9b86-97821b9a59c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 Sep 01 07:21:52.390168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 510/1030] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:52.415224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:52.417340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:52.423578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:52.424053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:52.424482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:52.425184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:52.425630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:52.426055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:52.455481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1bc5f7a2-bd9d-480c-ab09-5460a770fe40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Sep 01 07:21:52.456031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 521/1031] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:53.208117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:53.210329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:53.216236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:53.216719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:53.217704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:53.218397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:53.218853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:53.219280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:53.248285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5911ee2c-3bde-4c9b-a423-52c3d6af2dc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044144 Sep 01 07:21:53.248830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 511/1032] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:53.401708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:53.403854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:53.410291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:53.410765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:53.411197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:53.411871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:53.412315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:53.412732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:53.437707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:53.443053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f099567b-7526-4307-91f8-30a78c45db28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Sep 01 07:21:53.443606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 522/1033] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:53.468120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:53.470243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:53.476569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:53.477055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:53.477531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:53.478220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:53.478680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:53.479107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:53.507954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a96fb95-e563-4d4d-905d-34a7f3072aaf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044371 Sep 01 07:21:53.508499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 512/1034] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:54.260248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:54.262385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:54.268990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:54.269504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:54.269934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:54.270607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:54.271057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:54.271474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:54.300487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb076a25-d866-4cce-bb9b-d4e3427fe52a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044477 Sep 01 07:21:54.301023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 523/1035] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:54.455806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:54.458205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:54.464901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:54.465441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:54.465889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:54.466602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:54.467067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:54.468179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:54.497047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e558fa77-23c5-42c6-916a-0f78246803a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Sep 01 07:21:54.497628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 513/1036] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:54.520301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:54.522380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:54.528656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:54.529189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:54.530238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:54.530919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:54.531370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:54.531783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:54.559866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-50993117-9ac9-463e-baa2-5f41cf3852eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Sep 01 07:21:54.560412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 524/1037] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:55.312510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:55.314679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:55.320602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:55.321078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:55.321541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:55.322251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:55.322699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:55.323121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:55.352109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed020504-9664-44f4-841e-ccf8dcc4bb84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044116 Sep 01 07:21:55.352657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 514/1038] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:55.509259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:55.511370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:55.517634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:55.518110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:55.518541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:55.519222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:55.519666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:55.520087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:55.549878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2fdab5e-662e-4f6c-9a4d-d7f89272acee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Sep 01 07:21:55.550480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 525/1039] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:55.571782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:55.573881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:55.579805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:55.580317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:55.580773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:55.581477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:55.581925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:55.582342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:55.611037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e467bd63-9e23-4021-a905-668cddc60f22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Sep 01 07:21:55.611576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 515/1040] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:56.364463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:56.366587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:56.372500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:56.372978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:56.373437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:56.374115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:56.374558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:56.374974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:56.403322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a091c1fd-d641-4bb5-a23c-a1926ed4c495 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042837 Sep 01 07:21:56.403860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 526/1041] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:56.562012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:56.564190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:56.570068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:56.570557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:56.571000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:56.571685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:56.572142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:56.572686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:56.602418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5b6f287d-448c-4551-99f5-63bbd3fbd10e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Sep 01 07:21:56.602960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 516/1042] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:56.623004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:56.625736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:56.631960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:56.632423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:56.632845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:56.633663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:56.634105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:56.634515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:56.662953 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-349e3978-e684-4344-9808-759120bede54 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Sep 01 07:21:56.663486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 527/1043] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:21:57.416119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:57.418262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:57.424160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:57.424640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:57.425079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:57.425795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:57.426249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:57.426675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:57.456734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54af284e-5fab-48d0-a055-70d7ccf45649 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044576 Sep 01 07:21:57.457250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 517/1044] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:57.614538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:57.616658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:57.622524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:57.622999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:57.623929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:57.624592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:57.625030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:57.625471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:57.654456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b87fe26-d933-4879-bd1f-2edbb00c5692 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Sep 01 07:21:57.654994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 528/1045] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:57.674930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:57.677043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:57.683253 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:57.683730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:57.684160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:57.685140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:57.685592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:57.686521 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:57.699707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:21:57.715818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-094c047b-8ae1-4bab-8b4c-2f91ab22b050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Sep 01 07:21:57.716300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 518/1046] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:58.469615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:58.471736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:58.477579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:58.478044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:58.478465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:58.479131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:58.479568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:58.479979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:58.508507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3e6abbe-802e-4f32-9e5a-6d0236fae120 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043477 Sep 01 07:21:58.509044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 529/1047] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:58.667113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:58.669324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:58.675904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:58.676485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:58.676822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:58.677555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:58.678011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:58.678437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:58.707867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5830b67-2570-46fd-a39e-c5b06b94d147 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Sep 01 07:21:58.708413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 519/1048] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:58.727775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:58.729889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:58.736788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:58.737298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:58.737731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:58.738409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:58.738850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:58.739271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:58.768654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-010509e1-9d4b-4b71-937f-8411dab665d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Sep 01 07:21:58.769225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 530/1049] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:59.520681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:59.522818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:59.528774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:59.529289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:59.529725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:59.530412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:59.530859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:59.531276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:59.559699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-767ec6f0-c99a-4b74-92f2-a7b87f9259e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043058 Sep 01 07:21:59.560231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 520/1050] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:21:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:21:59.719902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:59.722105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:59.727903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:59.728450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:59.728794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:59.729493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:59.729938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:59.730354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:59.760781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d5a56d6-f624-490c-9446-50f549fc59dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Sep 01 07:21:59.761362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 531/1051] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:21:59.780454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:21:59.784080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:21:59.790774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:59.791251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:59.791867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:59.792551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:21:59.792998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:21:59.793644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:21:59.823329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ad3f38bf-3ba6-4239-9166-1be10adce73f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Sep 01 07:21:59.823878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 521/1052] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:21:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:00.571892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:00.574014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:00.580355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:00.580827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:00.581285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:00.581963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:00.582406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:00.582831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:00.612109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c3ea9395-fa40-4825-9bad-f9ee958ca6a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044117 Sep 01 07:22:00.612597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 532/1053] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:00.774065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:00.776301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:00.782282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:00.782857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:00.783190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:00.783890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:00.784343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:00.784771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:00.814040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b52be962-b85e-4699-a239-63dd6a8c5c20 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045252 Sep 01 07:22:00.814596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 522/1054] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:00.835324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:00.837428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:00.843673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:00.844139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:00.844560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:00.845270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:00.845708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:00.846115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:00.873855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ae8a2fe0-598f-478e-88c4-fb293dccd35a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 Sep 01 07:22:00.874327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 533/1055] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:01.624245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:01.626432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:01.632336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:01.632818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:01.633295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:01.633985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:01.634438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:01.634865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:01.663685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1f9936c-3284-4379-89c9-626fe408b5e7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043419 Sep 01 07:22:01.664221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 523/1056] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:01.825707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:01.828376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:01.834463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:01.834937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:01.835364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:01.836040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:01.836480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:01.836896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:01.866315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-487a5f1c-b4b3-49b1-9861-361dbff28f9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Sep 01 07:22:01.866863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 534/1057] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:01.886297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:01.888594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:01.895363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:01.895839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:01.896271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:01.896948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:01.897421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:01.897840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:01.926260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fceb186a-16a1-4979-a172-8bd3b913aae6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Sep 01 07:22:01.926792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 524/1058] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:02.676420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:02.678559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:02.684474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:02.684949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:02.685408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:02.686087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:02.686531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:02.686947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:02.715803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e802f248-d6c5-4187-ac1e-4ba820942ce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043340 Sep 01 07:22:02.716339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 535/1059] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:02.878406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:02.880472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:02.886370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:02.886932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:02.887289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:02.888256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:02.888709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:02.889152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:02.917725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ee1bfe41-bb78-41ef-99ff-b62e551a3537 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043335 Sep 01 07:22:02.918269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 525/1060] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:02.938153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:02.940266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:02.946535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:02.947000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:02.947454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:02.948124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:02.948561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:02.948979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:02.976967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85cbf4c1-7737-411d-a338-aa181ab22e02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Sep 01 07:22:02.977527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 536/1061] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:03.727845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:03.729979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:03.735954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:03.736437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:03.736869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:03.737608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:03.738056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:03.738477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:03.769451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dcc7ef93-9b40-4d81-a297-33b73d78ecfd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045479 Sep 01 07:22:03.770012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 526/1062] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:03.929533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:03.931625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:03.938031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:03.938498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:03.939031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:03.939573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:03.940015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:03.940426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:03.969588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-655631a0-7896-47ed-bc4f-cedaff1aa3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Sep 01 07:22:03.970054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 537/1063] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:03.989653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:03.991751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:03.998236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:03.998709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:03.999141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:04.000426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:04.000871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:04.001322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:04.029965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7244caa-ca70-4749-a19d-20e3bffccd0b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Sep 01 07:22:04.030520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 527/1064] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:04.781773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:04.783941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:04.789787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:04.790253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:04.790683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:04.791352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:04.791786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:04.792197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:04.821617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aa0d0f59-5c5b-42dd-98d8-9f7dd3e38f4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043723 Sep 01 07:22:04.822166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 538/1065] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:04.982036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:04.984601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:04.986455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:04.991599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:04.992179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:04.992503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:04.993222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:04.993681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:04.994107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:05.024372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c4e44888-b049-4a97-b3a9-16b4f15e00de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046358 Sep 01 07:22:05.024927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 528/1066] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:05.041968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:05.044068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:05.050826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:05.051295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:05.051722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:05.052397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:05.052843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:05.053296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:05.067237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:05.082632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f8754d0-112a-4c8d-8456-e00d3f6d7249 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044589 Sep 01 07:22:05.083174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 539/1067] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:05.834761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:05.836893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:05.842693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:05.843163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:05.844243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:05.844918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:05.845393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:05.845859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:05.874162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bea87554-5d1e-40c0-abf8-12397670a25d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043381 Sep 01 07:22:05.875216 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 529/1068] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:06.036452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:06.038630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:06.044415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:06.045001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:06.045346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:06.046027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:06.046470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:06.046917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:06.075858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4feb2cfd-a773-4875-962e-e4889f4f26d5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Sep 01 07:22:06.076388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 540/1069] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:06.094000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:06.096155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:06.102464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:06.102947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:06.103385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:06.104072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:06.104525 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:06.104953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:06.133030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e851cfbe-186d-4446-8071-66f04f550393 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042962 Sep 01 07:22:06.133602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 530/1070] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:06.887047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:06.889372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:06.895249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:06.895725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:06.896154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:06.896838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:06.897317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:06.897741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:06.927067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cbbcea85-1be3-409f-ad5c-a0aaac1990a0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044102 Sep 01 07:22:06.927615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 541/1071] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:07.087804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:07.089964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:07.096353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:07.096926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:07.097273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:07.097955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:07.098406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:07.098821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:07.127096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c088dbab-22df-4cbe-b356-004eb537001a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Sep 01 07:22:07.127624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 531/1072] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:07.145536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:07.147705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:07.153998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:07.154477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:07.154904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:07.155609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:07.156659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:07.157107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:07.185513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56f00777-f1cf-4c02-abb7-97763528ad9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Sep 01 07:22:07.186058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 542/1073] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:07.940063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:07.942254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:07.948192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:07.948656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:07.949091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:07.949799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:07.950246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:07.950665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:07.983063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0c18d29-30d7-4076-9a7b-e5fb000511cf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047663 Sep 01 07:22:07.983628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 532/1074] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:08.139596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:08.141789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:08.143701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:08.151280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:08.151943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:08.152178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:08.152868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:08.153348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:08.153769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:08.187627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4e67662-016a-41f2-b365-3780fa167f6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052257 Sep 01 07:22:08.188181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 543/1075] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:08.197671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:08.201333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:08.208023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:08.208541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:08.208979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:08.209698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:08.210152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:08.210574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:08.243382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eecc96fa-723c-465d-844f-956be3a942a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049778 Sep 01 07:22:08.243948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 533/1076] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:08.995870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:08.997960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:09.004299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:09.004769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:09.005227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:09.005904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:09.006346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:09.006766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:09.035734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a309187d-93aa-4ece-b422-aa2c628d46c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043938 Sep 01 07:22:09.036273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 544/1077] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:09.199827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:09.201986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:09.208829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:09.209349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:09.209811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:09.210507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:09.210964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:09.211392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:09.240244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a311e0a0-2fcf-4851-89d7-f5fbb20cbbf4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Sep 01 07:22:09.240799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 534/1078] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:09.256153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:09.258292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:09.264765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:09.265299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:09.265755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:09.266449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:09.266895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:09.267312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:09.295326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f6e852b-fd7c-4d62-a91a-38986d8d3c5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Sep 01 07:22:09.295874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 545/1079] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:10.047553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:10.049727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:10.055707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:10.056179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:10.056609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:10.057334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:10.057783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:10.058201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:10.061981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:10.087164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1ccd323-7e98-408b-8e30-bab5e98ec925 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043592 Sep 01 07:22:10.087702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 535/1080] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:10.252309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:10.254601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:10.260428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:10.261025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:10.261337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:10.262005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:10.262440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:10.263115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:10.293936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42d2e0d1-6f60-4415-b5c3-75d2381ae665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Sep 01 07:22:10.294478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 546/1081] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:10.307836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:10.309985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:10.316372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:10.316855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:10.317342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:10.318031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:10.318485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:10.318910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:10.348763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2aca3147-eee7-4e1c-8385-1031fbf5b7b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Sep 01 07:22:10.349355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 536/1082] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:11.099858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:11.101974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:11.107792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:11.108259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:11.108684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:11.110004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:11.110441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:11.110853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:11.139100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7637932-d021-4463-8b55-f8353726f561 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043198 Sep 01 07:22:11.139633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 547/1083] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:11.306234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:11.308393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:11.314657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:11.315131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:11.315564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:11.316239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:11.316684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:11.317104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:11.345609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ff726ed5-7eac-46eb-97b4-c07f54980eec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Sep 01 07:22:11.346158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 537/1084] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:11.360432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:11.362667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:11.368882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:11.369382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:11.369803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:11.370470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:11.370903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:11.371346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:11.399275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40892cd8-47dd-41f8-9a7b-fa087658945d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Sep 01 07:22:11.399985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 548/1085] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:12.151278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:12.153475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:12.160075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:12.160556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:12.160987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:12.161706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:12.162154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:12.162572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:12.192529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe83d94d-bd38-47df-8fe2-b6cf3d1a08b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045170 Sep 01 07:22:12.193089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 538/1086] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:12.357728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:12.359828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:12.366117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:12.366670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:12.367000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:12.367669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:12.368106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:12.368525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:12.397927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2956d8a0-6a23-431c-b3ac-400478ccfdeb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Sep 01 07:22:12.398470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 549/1087] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:12.411853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:12.413938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:12.420165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:12.420640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:12.421077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:12.421786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:12.422238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:12.422664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:12.450517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-378bbf1c-693f-4548-a2a1-02df392ed189 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042596 Sep 01 07:22:12.451069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 539/1088] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:13.203864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:13.206029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:13.211965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:13.212428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:13.212847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:13.213543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:13.213980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:13.214387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:13.248349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c582085-021d-4c8e-898a-786dd23083fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048339 Sep 01 07:22:13.248919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 550/1089] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:13.410523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:13.412659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:13.419024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:13.419512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:13.419951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:13.420648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:13.421105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:13.422214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:13.451995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7dffd1a4-519f-45bd-a9f8-b49a90fe0f8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045908 Sep 01 07:22:13.452561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 540/1090] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:13.462747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:13.464794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:13.471646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:13.472110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:13.472530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:13.473235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:13.473677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:13.474082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:13.503303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d997139f-46ce-4ecf-8e67-2510df7a1a89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Sep 01 07:22:13.503859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 551/1091] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:14.261515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:14.263938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:14.269799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:14.270278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:14.270717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:14.271400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:14.271857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:14.272283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:14.301431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-476a59cf-4f80-4c2c-a02f-94d166ea6b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043936 Sep 01 07:22:14.301971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 541/1092] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:14.464797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:14.467060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:14.473416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:14.473888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:14.474318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:14.474995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:14.475439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:14.475854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:14.505282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-643a291c-d270-49d0-a3ab-8de8d7302a8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Sep 01 07:22:14.505836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 552/1093] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:14.515632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:14.517761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:14.524143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:14.524631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:14.525070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:14.525787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:14.526369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:14.526663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:14.556313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56e7ce81-c705-4154-8af1-631616a578eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Sep 01 07:22:14.556869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 542/1094] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:22:15.314249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:15.316394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:15.322379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:15.322857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:15.323289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:15.323966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:15.324408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:15.324827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:15.353672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee5bbe94-f567-4da2-b744-3efa40d96eee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043940 Sep 01 07:22:15.354217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 553/1095] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:15.517735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:15.519966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:15.526237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:15.526714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:15.527148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:15.529087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:15.529946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:15.530383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:15.559766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c3f5050-802d-4b7d-9408-2f87869be165 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045955 Sep 01 07:22:15.560325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 543/1096] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:15.568586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:15.570816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:15.577204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:15.577650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:15.578083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:15.578762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:15.579208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:15.579628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:15.608412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-87b92c8f-6760-4a5c-b237-2e85c6cc4dcc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Sep 01 07:22:15.609576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 554/1097] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:16.365265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:16.367411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:16.373609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:16.374080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:16.375151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:16.376272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:16.376945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:16.377596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:16.407073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-824498d1-1a96-418d-ac0b-efeaea33293d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Sep 01 07:22:16.407626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 544/1098] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:16.572723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:16.574912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:16.582047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:16.582464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:16.582889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:16.583567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:16.584007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:16.584420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:16.612990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3472f3f-9c37-4121-8ef2-2ccdb13b2fc1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Sep 01 07:22:16.613563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 555/1099] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:16.621040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:16.623332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:16.630088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:16.630570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:16.631016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:16.631735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:16.632186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:16.632608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:16.661757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-add3da23-ac5d-46f1-9a37-5d7d894ebab7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Sep 01 07:22:16.662307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 545/1100] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:17.419987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:17.422569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:17.429244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:17.429731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:17.430159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:17.430849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:17.431290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:17.431708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:17.435488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:17.463314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a58a23f-28ef-459b-8715-f3aab8591f8a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047183 Sep 01 07:22:17.463873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 556/1101] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:17.625927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:17.628104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:17.634301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:17.634780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:17.635207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:17.635905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:17.636333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:17.636756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:17.665843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb6dfbe9-9b67-4a5c-9f8e-5f029c29b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Sep 01 07:22:17.666392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 546/1102] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:17.674355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:17.676536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:17.682920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:17.683368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:17.683794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:17.684495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:17.684933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:17.685381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:17.713663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc708ab4-0e5a-454d-b833-7801d4b05ee2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Sep 01 07:22:17.714205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 557/1103] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:18.476245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:18.478379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:18.484274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:18.484753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:18.485289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:18.485980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:18.486431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:18.486856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:18.516594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94c3b986-03d6-4ba7-a144-b3d2000149f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043728 Sep 01 07:22:18.517162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 547/1104] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:18.678691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:18.680802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:18.687378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:18.687851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:18.688840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:18.689471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:18.689914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:18.690322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:18.720843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ced2d12-f4be-4d3c-b9c9-178c649af5a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Sep 01 07:22:18.720843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 558/1105] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:18.726131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:18.728282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:18.734856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:18.735345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:18.735776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:18.736458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:18.736909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:18.737509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:18.768799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-35c97fe7-736d-49ce-8c3e-94877ea40d81 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046358 Sep 01 07:22:18.769289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 548/1106] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:19.530717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:19.533420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:19.539259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:19.539726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:19.540147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:19.540814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:19.541274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:19.541681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:19.570089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b108bbcb-9f84-4be4-a1af-8875aad819fb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043319 Sep 01 07:22:19.570622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 559/1107] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:19.732179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:19.734373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:19.740616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:19.741099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:19.741565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:19.742254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:19.742705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:19.743129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:19.772887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dfad0d96-19b1-4968-b429-d1aa03906996 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Sep 01 07:22:19.773477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 549/1108] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:22:19.779771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:19.781962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:19.788805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:19.789327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:19.789763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:19.790441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:19.790882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:19.791296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:19.818956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9ba40fe-5048-4f11-a240-a8c60b5d8735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Sep 01 07:22:19.819491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 560/1109] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:20.582396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:20.584578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:20.590676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:20.591156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:20.591596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:20.592280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:20.592733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:20.593188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:20.622543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-152ff762-c5d6-4aa5-8fa5-150fed0ac83f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044140 Sep 01 07:22:20.623085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 550/1110] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:20.784801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:20.786925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:20.793247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:20.793722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:20.794150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:20.794825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:20.795268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:20.795683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:20.824903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-493ac410-ae9a-4d6c-92b7-7de3715d801a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Sep 01 07:22:20.825542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 561/1111] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:22:20.831362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:20.833729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:20.840084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:20.840569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:20.841011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:20.841728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:20.842184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:20.842612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:20.867265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:20.872377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-23dbfb07-c175-40f0-911d-a984e2ecfcb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Sep 01 07:22:20.872925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 551/1112] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:21.635448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:21.637600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:21.644407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:21.644879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:21.645350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:21.646023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:21.646469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:21.646895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:21.674941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39d285f2-b0f3-4aaf-badc-9bbb4cc710f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043463 Sep 01 07:22:21.675477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 562/1113] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:21.836490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:21.838678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:21.845179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:21.845662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:21.846095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:21.846782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:21.847230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:21.847657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:21.876170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5887d589-7517-4eae-bdee-2e9cb295ee7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Sep 01 07:22:21.876716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 552/1114] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:21.883741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:21.885932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:21.893024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:21.893531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:21.893963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:21.894640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:21.895083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:21.895499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:21.926491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b73e7e0-ac84-44a4-a44a-4b65a964eacc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Sep 01 07:22:21.927043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 563/1115] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:22.687751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:22.690492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:22.696355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:22.696835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:22.697322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:22.698013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:22.698466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:22.698895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:22.727649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-75714287-09fe-4c26-8dfc-cfd25ce0a99c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043914 Sep 01 07:22:22.728197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 553/1116] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:22.887859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:22.890201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:22.896479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:22.896948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:22.897417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:22.898093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:22.898535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:22.898951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:22.927424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb827f20-e73d-49bc-8524-8f6af8a4e1c6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Sep 01 07:22:22.927955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 564/1117] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:22.939364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:22.941800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:22.948026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:22.948505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:22.948941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:22.949669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:22.950119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:22.950546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:22.978347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1cb93b70-14b3-45be-828b-77a16f79ed1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Sep 01 07:22:22.978888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 554/1118] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:23.740074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:23.742118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:23.748043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:23.748514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:23.748946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:23.749648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:23.750089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:23.750505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:23.781042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67475313-cf86-4887-baaa-a8d6711f6c80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045014 Sep 01 07:22:23.781663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 565/1119] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:23.939992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:23.942128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:23.948056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:23.948532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:23.948963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:23.949695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:23.950142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:23.950857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:23.979640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-82b7abfd-292e-4ec1-b5b2-f8aa85a92716 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Sep 01 07:22:23.980181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 555/1120] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:23.990401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:23.992497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:23.998767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:23.999234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:23.999673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:24.000868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:24.001303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:24.001717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:24.030634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-efc94953-06e2-4a3d-9ccd-63aa1ab465aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Sep 01 07:22:24.031174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 566/1121] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:24.794004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:24.796138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:24.802066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:24.802550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:24.802987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:24.803679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:24.804128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:24.804550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:24.834447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-476a9a18-868d-4f54-a359-32c3976d5e43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044456 Sep 01 07:22:24.834998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 556/1122] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:24.991824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:24.993940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:25.001273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:25.001741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:25.002161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:25.002828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:25.003264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:25.003672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:25.032033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-57af38e3-7c2b-435b-8128-60739b12853d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Sep 01 07:22:25.032575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 567/1123] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:25.042579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:25.044696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:25.051528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:25.052044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:25.052481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:25.053214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:25.053653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:25.054074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:25.082471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-112a96c4-3608-4d09-a0dc-078f8512335a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Sep 01 07:22:25.083017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 557/1124] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:25.846406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:25.848522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:25.854450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:25.854917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:25.855337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:25.856007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:25.856442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:25.856849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:25.885408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea19f755-374b-4cf8-87a1-2f5e0a8d273e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043433 Sep 01 07:22:25.885947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 568/1125] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:26.043985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:26.046141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:26.052188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:26.052700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:26.053163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:26.053859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:26.054316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:26.054746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:26.084098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65a67cb1-e0d1-4f00-a5e2-836b296a14e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Sep 01 07:22:26.084641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 558/1126] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:26.094462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:26.096543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:26.102803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:26.103268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:26.103691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:26.104361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:26.104799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:26.105242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:26.133590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e18daa25-688f-4749-8556-ae944352a27f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043056 Sep 01 07:22:26.134122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 569/1127] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:26.897798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:26.899910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:26.905739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:26.906211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:26.907161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:26.907841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:26.908288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:26.908714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:26.936988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-43b39a05-14af-4bd0-a50d-cd406782b735 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043056 Sep 01 07:22:26.937623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 559/1128] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:27.096097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:27.098203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:27.104531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:27.104996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:27.105454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:27.106119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:27.106558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:27.106968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:27.135306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1ae9bc2-1b33-49df-b747-443e7065909d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Sep 01 07:22:27.135777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 570/1129] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:27.145477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:27.147588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:27.153747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:27.154223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:27.154659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:27.155341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:27.155788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:27.156210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:27.184770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8bacf0d2-8af3-49dc-bc53-cc0e67fae277 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043703 Sep 01 07:22:27.185369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 560/1130] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:27.950262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:27.953000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:27.959692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:27.960163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:27.960589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:27.961301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:27.961743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:27.962155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:27.991675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93a7bc72-4bef-487c-a2a9-dcc5c720e37e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045771 Sep 01 07:22:27.992219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 571/1131] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:28.147462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:28.149659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:28.155967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:28.156450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:28.156923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:28.157645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:28.158106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:28.158536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:28.187377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-685e2a6a-3c04-4400-95e4-1aa381269270 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Sep 01 07:22:28.188576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 561/1132] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:28.197545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:28.199682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:28.205966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:28.206460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:28.206883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:28.207549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:28.207984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:28.208392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:28.231976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:28.237865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6383cebe-d5e1-4411-ae07-4afd053ae57b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Sep 01 07:22:28.238428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 572/1133] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:29.004412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:29.006512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:29.012335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:29.012844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:29.013574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:29.014268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:29.014722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:29.015147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:29.043732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ea1de4e-cbd0-4f40-94d7-2551f16d05c2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Sep 01 07:22:29.044269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 562/1134] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:29.199964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:29.202124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:29.208862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:29.209373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:29.209807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:29.210649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:29.211127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:29.211325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:29.240507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b47bf7ef-a00e-4d47-92cf-7fb0c47d4ae6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Sep 01 07:22:29.241041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 573/1135] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:29.251373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:29.253565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:29.259862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:29.260318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:29.260776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:29.261486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:29.261932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:29.262349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:29.291312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68d7056c-45eb-4da8-a403-e23c4ba37668 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Sep 01 07:22:29.291856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 563/1136] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:30.056038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:30.058176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:30.064442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:30.064903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:30.065356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:30.066025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:30.066460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:30.066869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:30.095612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7dfec0d0-1580-4088-98d6-b6bbb9c70312 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043554 Sep 01 07:22:30.096143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 574/1137] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:30.253030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:30.255109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:30.262148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:30.262644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:30.263082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:30.264043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:30.264494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:30.264920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:30.294160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f870c4f5-3de8-41a8-9233-d9abb11c4652 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Sep 01 07:22:30.294713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 564/1138] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:30.303831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:30.305973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:30.312217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:30.312628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:30.313679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:30.314354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:30.314792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:30.315203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:30.343524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f6e4a4b2-166a-4c01-9a0e-0b05f2ee7333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Sep 01 07:22:30.344139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 575/1139] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:31.107621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:31.109784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:31.115710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:31.116185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:31.116619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:31.117326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:31.117806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:31.118226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:31.146872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8172b2d1-9924-4ec7-8a7f-66ba8dff9e58 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043119 Sep 01 07:22:31.147401 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 565/1140] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:31.306780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:31.308909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:31.315933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:31.316400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:31.316830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:31.317548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:31.317988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:31.318396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:31.347253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aadb2f6b-bf20-49ac-83c6-be22d82eaf08 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Sep 01 07:22:31.347791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 576/1141] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:31.355587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:31.357757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:31.364148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:31.364630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:31.365066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:31.365782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:31.366230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:31.366650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:31.396013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f1edebb-2b29-4c73-af67-c361a2fb1228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Sep 01 07:22:31.396557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 566/1142] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:22:32.159584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:32.161715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:32.167563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:32.168036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:32.168463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:32.169156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:32.169603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:32.170019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:32.198696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7c9dd08-9c69-42cb-ae4e-af35e4b5077f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043679 Sep 01 07:22:32.199253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 577/1143] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:32.359380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:32.362154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:32.368449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:32.368928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:32.369402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:32.370090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:32.370539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:32.370958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:32.399777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9fe1f345-f77e-4431-9f7b-02aba4a0498c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Sep 01 07:22:32.400325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 567/1144] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:32.408279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:32.410532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:32.416292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:32.416767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:32.417239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:32.417916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:32.418359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:32.418780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:32.447916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5bbfe4d2-3413-47e4-9fd8-cacb86b56111 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Sep 01 07:22:32.448465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 578/1145] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:33.210909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:33.213029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:33.218891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:33.219948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:33.220402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:33.221073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:33.221547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:33.221970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:33.235359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:33.252717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe102b49-2540-45d6-bd21-1cb2ad6620fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045765 Sep 01 07:22:33.253295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 568/1146] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:33.412392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:33.414571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:33.420866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:33.421376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:33.421810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:33.422493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:33.422937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:33.423355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:33.460735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:33.463033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:33.470549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:33.471211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:33.471653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:33.472378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:33.472810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:33.473257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:33.505558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3cc22db2-0706-402b-85ef-4f47a69aaec6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048687 Sep 01 07:22:33.506143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 569/1147] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:22:33.602975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-265a4dbc-a2db-48b0-ae01-df2e8732d37d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194468 Sep 01 07:22:33.603512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 579/1148] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:34.264161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:34.266538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:34.274251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:34.274828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:34.275578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:34.276784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:34.277651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:34.278455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:34.310314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-32e0093a-2ebe-4484-a440-1591c381e6e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050370 Sep 01 07:22:34.310806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 570/1149] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:34.518062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:34.520156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:34.526505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:34.526978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:34.527406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:34.528077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:34.528520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:34.528936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:34.558012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c241becb-c87f-4c04-bc00-e89d6ff17b98 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Sep 01 07:22:34.558559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 580/1150] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:34.615627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:34.617865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:34.624064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:34.624538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:34.625174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:34.625916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:34.626364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:34.626784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:34.655402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2efd735-09f0-49b1-8d99-adda35202b3e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Sep 01 07:22:34.655947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 571/1151] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:35.322403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:35.324435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:35.330870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:35.331336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:35.331758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:35.332423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:35.332857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:35.333297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:35.362110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b953bbcd-d17a-475e-8641-65c2ddd3fc69 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043684 Sep 01 07:22:35.362640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 581/1152] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:35.570310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:35.572500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:35.574322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:35.580094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:35.580580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:35.581023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:35.581758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:35.582217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:35.582648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:35.613598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-edd94e64-b9df-4bbf-97da-fe62f6b504b2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Sep 01 07:22:35.614147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 572/1153] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:35.667491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:35.669607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:35.671525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:22:35.671666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:22:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments (ip 10.222.0.46) !!! Sep 01 07:22:35.681024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:35.681526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:35.681950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:35.682634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:35.683073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:35.683486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:35.714512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d20bf241-7682-44b9-aa9f-72930dcdaf35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050965 Sep 01 07:22:35.715050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 582/1154] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:36.374254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:36.376362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:36.382582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:36.383055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:36.383486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:36.384169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:36.384614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:36.385182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:36.414920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f9879e3c-61f4-4bcf-9100-4fe1ba6ea3ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044928 Sep 01 07:22:36.415461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 573/1155] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:36.626369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:36.628446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:36.634374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:36.634853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:36.635285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:36.635965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:36.636417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:36.636837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:36.665080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52627cc5-1243-4c34-8906-126943c414a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Sep 01 07:22:36.665643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 583/1156] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:36.726413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:36.728523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:36.730485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:22:36.730631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:22:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments (ip 10.222.0.46) !!! Sep 01 07:22:36.732505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:22:36.732656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:22:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments (ip 10.222.0.46) !!! Sep 01 07:22:36.746317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:36.746813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:36.747260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:36.747968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:36.748429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:36.748859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:36.781304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5b699943-9237-4efb-bb47-e8f0ebb6544f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058719 Sep 01 07:22:36.781869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 574/1157] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:22:37.427394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:37.429426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:37.435688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:37.436153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:37.436576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:37.437307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:37.438247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:37.438656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:37.467168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fdf109ba-b120-4661-976b-b315b55c4cbe tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043859 Sep 01 07:22:37.467694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 584/1158] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:37.677720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:37.679959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:37.686256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:37.686736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:37.687169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:37.688362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:37.688811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:37.689262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:37.718187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eeb5487f-a590-4d37-9618-e3629b68da82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Sep 01 07:22:37.718742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 575/1159] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:37.793420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:37.795533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:37.802207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:37.802687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:37.803125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:37.803816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:37.804262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:37.804685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:37.833742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e35a38c-88a8-4ed0-80fb-c488d23cea3a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Sep 01 07:22:37.834470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 585/1160] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:38.479352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:38.481542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:38.487402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:38.487877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:38.488305 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:38.488981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:38.489457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:38.489874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:38.518645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19b07f0f-89e3-43b2-af8a-51e20ce1548f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043347 Sep 01 07:22:38.519179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 576/1161] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:22:38.730559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:38.732578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:38.734977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:38.740129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:38.740603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:38.741038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:38.741739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:38.742185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:38.742604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:38.771968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b37d06f0-9e2c-4629-8448-254358440c33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Sep 01 07:22:38.772516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 586/1162] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:38.846168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:38.848602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:38.854917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:38.855392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:38.855824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:38.856503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:38.856947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:38.857666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:38.886643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbe78525-b715-478a-b6cc-7e94f5bff287 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Sep 01 07:22:38.887195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 577/1163] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:39.530839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:39.533509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:39.539408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:39.539879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:39.540306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:39.540980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:39.541454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:39.541870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:39.574737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c40b3275-c897-4f51-965b-b21125ba238a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047867 Sep 01 07:22:39.575288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 587/1164] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:39.784846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:39.786932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:39.792732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:39.793236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:39.793666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:39.794344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:39.794790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:39.795207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:39.824174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1d1c01f-a3c7-4594-bc9d-5d1b9049c8f1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Sep 01 07:22:39.824718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 578/1165] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:39.899393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:39.901539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:39.907912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:39.909032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:39.909514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:39.910192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:39.910692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:39.911114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:39.939648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12049cdc-d803-4889-86b5-f35cc0d17ee5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Sep 01 07:22:39.940208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 588/1166] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:40.587563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:40.589716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:40.595978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:40.596457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:40.596893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:40.597602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:40.598053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:40.598490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:40.627588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1deaded7-ec11-45b2-a514-45d7d4649345 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043487 Sep 01 07:22:40.628136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 579/1167] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:40.836045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:40.838205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:40.843970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:40.844433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:40.844852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:40.845566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:40.846003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:40.846411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:40.859532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:40.875291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37c4eb16-4c06-4098-ae32-d26e74dc2333 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043224 Sep 01 07:22:40.875824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 589/1168] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:40.951431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:40.953585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:40.959550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:40.960031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:40.960468 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:40.961176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:40.961631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:40.962055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:40.990942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-72d2df06-ae56-4e73-a8b3-c412e3341b5f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Sep 01 07:22:40.991481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 580/1169] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:41.640429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:41.642577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:41.649364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:41.649830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:41.650254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:41.650918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:41.651356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:41.651766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:41.680181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f6cf6b8-b6ed-40fd-ad4f-fc6a7ae7c53c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043963 Sep 01 07:22:41.680712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 590/1170] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:41.887958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:41.890341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:41.897526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:41.897951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:41.898380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:41.899057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:41.899501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:41.899916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:41.927601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f394e7e3-a617-4fa0-80e2-72e9e51ad2e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Sep 01 07:22:41.928143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 581/1171] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:42.003432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:42.005565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:42.011396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:42.011871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:42.012302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:42.012976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:42.013704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:42.014121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:42.042552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b3490f7-7183-402f-949e-3e1efe736a53 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Sep 01 07:22:42.043083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 591/1172] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:42.692348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:42.694522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:42.700353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:42.700833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:42.701311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:42.701998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:42.702455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:42.702876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:42.732000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb9c07ad-8f51-421c-9f1e-c3fd689496e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043653 Sep 01 07:22:42.732534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 582/1173] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:42.939748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:42.942000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:42.948418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:42.948889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:42.949361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:42.950042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:42.950518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:42.950936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:42.980311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7cfd0d1a-9023-453d-9c0a-41b04d49a228 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Sep 01 07:22:42.980852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 592/1174] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:43.053724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:43.055844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:43.062077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:43.062570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:43.063000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:43.063688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:43.064140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:43.064565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:43.093105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5ec21a7-c706-4a7b-a9cc-c98ce8db0a34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 Sep 01 07:22:43.093659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 583/1175] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:43.745109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:43.747352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:43.753745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:43.754213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:43.754637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:43.755309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:43.755743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:43.756155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:43.785280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc2c8bb1-d507-4e72-98ce-4f78706579e0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Sep 01 07:22:43.785820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 593/1176] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:43.992438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:43.994547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:44.000467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:44.000944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:44.001412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:44.002716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:44.003163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:44.003581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:44.031657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c918a29b-985d-4ffd-9c5f-1b17c5ca6ece tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Sep 01 07:22:44.032193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 584/1177] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:44.105088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:44.107253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:44.114221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:44.114701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:44.115132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:44.115806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:44.116248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:44.116666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:44.144803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee13070d-66ed-4d73-a781-1937986cdc0f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Sep 01 07:22:44.145360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 594/1178] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:44.797567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:44.799709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:44.806188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:44.806657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:44.807085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:44.807792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:44.808237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:44.808653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:44.812137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:44.839472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-97950fc6-5ff6-4303-99ab-7740d80b0330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045949 Sep 01 07:22:44.840019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 585/1179] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:45.043824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:45.045936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:45.051854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:45.052321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:45.052745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:45.053505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:45.053942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:45.054353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:45.082838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36061153-a9cb-4ffa-bbdb-8febad81d531 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Sep 01 07:22:45.083373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 595/1180] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:45.156602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:45.158761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:45.164488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:45.164959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:45.165413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:45.166088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:45.166533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:45.166949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:45.195922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3ea6fad-898b-494f-8732-8f38b2bdcf82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043184 Sep 01 07:22:45.196458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 586/1181] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:45.852449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:45.854720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:45.860938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:45.861485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:45.862411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:45.863080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:45.863517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:45.863927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:45.893178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc398a3b-1bdf-4ed9-8960-9b31182c934c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044259 Sep 01 07:22:45.893711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 596/1182] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:46.095146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:46.098042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:46.104490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:46.105008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:46.105476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:46.106165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:46.106620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:46.107046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:46.135002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b92edc93-db41-4645-a76a-ca25bfbea5be tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Sep 01 07:22:46.135537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 587/1183] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:46.208297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:46.210477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:46.216430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:46.216908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:46.217381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:46.218067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:46.218530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:46.218934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:46.247832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e58ab9d-4ab6-4d03-b139-d61f71569acb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Sep 01 07:22:46.248368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 597/1184] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:46.905600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:46.907924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:46.914345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:46.914820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:46.915250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:46.916128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:46.916577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:46.916997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:46.946615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ae243bf0-1597-4331-a5dd-1af807232b19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045203 Sep 01 07:22:46.947154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 588/1185] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:47.147715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:47.149861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:47.156186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:47.156661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:47.157094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:47.157798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:47.158838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:47.159292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:47.187907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7da170c-30be-4375-9eb7-8f287773cd04 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Sep 01 07:22:47.188435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 598/1186] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:47.264861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:47.267015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:47.274753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:47.275236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:47.275674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:47.276364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:47.276815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:47.277271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:47.308745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9da07d3-3344-43e5-a46b-ea3d229dbbaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049042 Sep 01 07:22:47.309356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 589/1187] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:47.958909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:47.961062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:47.966939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:47.967411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:47.967842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:47.968518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:47.968965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:47.969408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:47.999527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28838961-f1cb-480a-a2ee-530a61b10a10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044581 Sep 01 07:22:48.000071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 599/1188] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:48.199055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:48.201197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:48.207516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:48.207991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:48.208420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:48.209094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:48.209562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:48.209981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:48.238184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c86fb72-c30b-4cb4-970c-15be5365fe82 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Sep 01 07:22:48.238743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 590/1189] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:48.321370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:48.323479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:48.329446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:48.329921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:48.330352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:48.331604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:48.332051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:48.332466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:48.361758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91f839c3-ba45-490a-855e-8fee18ee9b8d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Sep 01 07:22:48.362301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 600/1190] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:49.011761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:49.014182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:49.020498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:49.020917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:49.021377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:49.022058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:49.022502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:49.022921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:49.051347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d053ecaa-6403-4b77-b077-896333134a3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043605 Sep 01 07:22:49.051882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 591/1191] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:49.250677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:49.253374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:49.259176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:49.259637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:49.260061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:49.260725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:49.261181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:49.261595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:49.290507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6ffa7a1-cbfe-436a-bd84-44400cfe47a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Sep 01 07:22:49.291039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 601/1192] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:49.374682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:49.376806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:49.382681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:49.383156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:49.383588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:49.384266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:49.384713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:49.385157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:49.414068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbcd95fb-1722-442b-a780-137d253dcb77 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Sep 01 07:22:49.414622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 592/1193] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:50.063698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:50.065874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:50.072642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:50.073109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:50.073680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:50.074358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:50.074799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:50.075212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:50.103841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c81c3d5e-d27f-4205-be94-2fc09c5d7a2f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044194 Sep 01 07:22:50.104374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 602/1194] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:50.302361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:50.304476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:50.306938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:22:50.307081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:22:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments (ip 10.222.0.46) !!! Sep 01 07:22:50.313293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:50.313855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:50.314250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:50.314951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:50.315404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:50.315828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:50.354986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1ba6c30-5dc5-4d8f-8870-5a3baeda89f2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056512 Sep 01 07:22:50.355550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 593/1195] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:50.426518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:50.428626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:50.434390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:50.434859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:50.435280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:50.435946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:50.436386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:50.436796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:50.465786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ce6f209-48db-45ba-888b-9d116869cbd6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Sep 01 07:22:50.466320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 603/1196] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:51.116581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:51.118758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:51.124652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:51.125154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:51.125599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:51.126289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:51.126743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:51.127170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:51.155769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b012ef48-42a8-4a9f-b3e7-ac95e56a4031 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043767 Sep 01 07:22:51.156303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 594/1197] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:51.367790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:51.369855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:51.376060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:51.376525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:51.376945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:51.377632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:51.378068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:51.378477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:51.406687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b75183a-3ff7-49c5-b75b-6d0f883fdacd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Sep 01 07:22:51.407219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 604/1198] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:51.478319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:51.480489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:51.486838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:51.487313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:51.487746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:51.488477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:51.488922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:51.489365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:51.519916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9223697-7dc7-4d7e-a5a6-18a7b9188b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Sep 01 07:22:51.520479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 595/1199] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:52.168524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:52.170661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:52.177017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:52.177525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:52.177953 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:52.178625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:52.179065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:52.179477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:52.208732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ec72ef4-2028-48b2-8d99-35adda5fe7a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044177 Sep 01 07:22:52.209314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 605/1200] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:52.419652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:52.421716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:52.428349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:52.428830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:52.429311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:52.429997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:52.430449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:52.430870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:52.460183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a97cea1c-0b58-41dd-a52d-e870632132dc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044619 Sep 01 07:22:52.460729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 596/1201] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:52.532181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:52.534345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:52.541148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:52.541622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:52.542052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:52.542727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:52.543165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:52.543576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:52.545925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:52.574819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb03f7dd-148b-4ba5-9c33-9c018a6d056e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046705 Sep 01 07:22:52.575363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 606/1202] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:53.220059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:53.222245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:53.228520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:53.228997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:53.229466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:53.230152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:53.230601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:53.231026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:53.260025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-32cc913b-37e6-4b46-aee7-df5bad56d61b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044019 Sep 01 07:22:53.260582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 597/1203] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:53.472048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:53.474704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:53.476640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:22:53.476782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments (ip 10.222.0.46) !!! Sep 01 07:22:53.482266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:53.482732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:53.483153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:53.483824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:53.484287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:53.484697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:53.513303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0de10878-5d9e-4483-a949-3d2220284cdd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 Sep 01 07:22:53.514099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 607/1204] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:53.586419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:53.588535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:53.594446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:53.594956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:53.595563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:53.596707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:53.597205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:53.598232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:53.626874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a41750f-383d-4c6f-92f0-fc8e969a097d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Sep 01 07:22:53.627429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 598/1205] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:54.272004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:54.274137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:54.280474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:54.280943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:54.281401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:54.282070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:54.282509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:54.282921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:54.312456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be5a541f-d0ed-4841-9f50-f3fa4f5913b7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Sep 01 07:22:54.313002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 608/1206] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:54.525802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:54.527923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:54.534248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:54.534730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:54.535674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:54.536355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:54.536804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:54.537258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:54.565623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffe69c0d-2411-477d-b0c1-ee1e7a21a7a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Sep 01 07:22:54.566166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 599/1207] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:54.640128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:54.642279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:54.648251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:54.648728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:54.649190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:54.649875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:54.650316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:54.650732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:54.680063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6dda03d6-2798-480f-85ad-e0296847c039 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Sep 01 07:22:54.680603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 609/1208] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:55.325435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:55.327567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:55.333415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:55.333890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:55.334319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:55.334997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:55.335449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:55.335868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:55.365111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e6ffc30-a463-48db-87fc-21980efe3550 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043713 Sep 01 07:22:55.365676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 600/1209] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:55.577918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:55.579991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:55.586451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:55.586924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:55.587348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:55.588021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:55.588462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:55.588880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:55.617937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97fce4aa-1f05-43da-a832-f5890cda913c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Sep 01 07:22:55.618469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 610/1210] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:55.692226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:55.694363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:55.700276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:55.700751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:55.701214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:55.701889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:55.702333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:55.702751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:55.728071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:22:55.733378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-77d8a4a6-b5bf-4d70-ba83-bd859f581eaf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Sep 01 07:22:55.733922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 601/1211] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:56.377360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:56.380107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:56.385997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:56.386474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:56.386901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:56.387579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:56.388022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:56.388440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:56.417664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89515fc1-6268-430b-bb71-2531e2dab1a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044305 Sep 01 07:22:56.418224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 611/1212] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:56.630083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:56.632152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:56.637996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:56.638481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:56.639173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:56.639866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:56.640333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:56.640761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:56.669025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7ae1f8c5-2d1b-412e-af44-bfc6851bcdf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043809 Sep 01 07:22:56.669610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 602/1213] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:56.745336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:56.747518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:56.753776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:56.754244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:56.754665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:56.755358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:56.755799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:56.756210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:56.785536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8ef9b20-2a46-4e1b-8216-dfd56062419d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Sep 01 07:22:56.786070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 612/1214] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:57.429413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:57.431548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:57.438811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:57.439290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:57.439728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:57.440516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:57.440920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:57.441382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:57.470489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36421fe4-b95c-4c15-8297-be5be9c17c6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045078 Sep 01 07:22:57.471035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 603/1215] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:57.682042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:57.684205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:57.690382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:57.690922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:57.691794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:57.692478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:57.692918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:57.693365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:57.722224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02428b18-e62e-4919-b94b-abce3be9e866 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Sep 01 07:22:57.722761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 613/1216] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:57.797703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:57.799873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:57.805697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:57.806179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:57.806618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:57.807301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:57.807757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:57.808180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:57.837472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5923f0a6-a6e6-43d8-a5ba-2b6d59644573 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043778 Sep 01 07:22:57.838009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 604/1217] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:58.483127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:58.485318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:58.487701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:22:58.487831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:22:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments (ip 10.222.0.46) !!! Sep 01 07:22:58.494373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:58.494854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:58.495284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:58.495966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:58.496409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:58.496826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:58.526764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96661e9a-c6cb-4d23-a847-675687166517 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047623 Sep 01 07:22:58.527312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 614/1218] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:22:58.734023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:58.736180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:58.742547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:58.743027 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:58.743461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:58.744144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:58.744592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:58.745012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:58.774720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-788f612c-cde7-468a-9a08-a0f3b520a691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Sep 01 07:22:58.775285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 605/1219] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:58.850167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:58.852344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:58.858158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:58.858627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:58.859054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:58.859731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:58.860172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:58.860596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:58.888806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42e09735-5a9f-482a-98b8-0bedd0e918cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043095 Sep 01 07:22:58.889364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 615/1220] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:59.538961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:59.541108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:59.547086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:59.547568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:59.548004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:59.548691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:59.549168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:59.549598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:59.578774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-41cfbc1a-a38e-47f7-b250-1df311914be6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043824 Sep 01 07:22:59.579317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 606/1221] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:22:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:22:59.785916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:59.788041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:59.794463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:59.794887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:59.795315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:59.795993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:59.796435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:59.796851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:59.825106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da415fb5-fa83-42a6-b711-3b0a235391f0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Sep 01 07:22:59.825663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 616/1222] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:22:59.900925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:22:59.903072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:22:59.909400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:59.909928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:59.910362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:59.911052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:22:59.911506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:22:59.911935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:22:59.939987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d765b169-ba1d-4a89-8827-58d43bb60725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043152 Sep 01 07:22:59.940536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 607/1223] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:22:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:00.591034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:00.593161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:00.599510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:00.599978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:00.600401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:00.601067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:00.601527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:00.601935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:00.630600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-847c76a0-dcf3-4da1-b76b-9386d01d74d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043532 Sep 01 07:23:00.631137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 617/1224] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:00.837087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:00.839319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:00.845303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:00.845769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:00.846210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:00.846906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:00.847873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:00.848304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:00.877138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa00ca04-4c07-472f-8802-8be4e66cee92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043919 Sep 01 07:23:00.877697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 608/1225] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:00.952524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:00.954729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:00.961625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:00.962103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:00.962533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:00.963211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:00.963657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:00.964072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:00.992963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7dbcce3-fba0-418a-b688-6054e44c8020 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Sep 01 07:23:00.993514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 618/1226] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:01.643300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:01.645445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:01.652059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:01.652535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:01.652965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:01.653683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:01.654131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:01.654550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:01.827873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-878e707a-2649-48e7-a173-85cd4024e964 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.188841 Sep 01 07:23:01.828413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 609/1227] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:23:01.889321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:01.891475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:01.898029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:01.898444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:01.898869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:01.899545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:01.899985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:01.900401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:01.928846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2642596b-a2e6-4e63-a525-52c17a063f4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Sep 01 07:23:01.929418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 619/1228] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:02.005529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:02.007602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:02.013390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:02.014142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:02.014575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:02.015250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:02.015694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:02.016113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:02.045331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ef3b4323-b88e-40c6-b0e5-72794e3f8486 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Sep 01 07:23:02.045869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 610/1229] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:02.839790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:02.841990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:02.848392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:02.848864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:02.849320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:02.850002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:02.850445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:02.850859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:02.879736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4692e275-32d5-41d9-b4ec-989e087979bd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043832 Sep 01 07:23:02.880211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 620/1230] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:02.940974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:02.943150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:02.949648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:02.950131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:02.950564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:02.951247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:02.951696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:02.952114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:02.980971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-03918ba0-ae7a-40f3-b9b6-7290fa4972ee tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Sep 01 07:23:02.981539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 611/1231] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:03.057602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:03.059736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:03.066026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:03.066503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:03.066937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:03.067617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:03.068065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:03.068492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:03.096582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82cae4b4-5816-4afc-bd21-8691f86c573e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Sep 01 07:23:03.097692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 621/1232] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:03.892091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:03.894250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:03.900113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:03.900588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:03.901019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:03.901723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:03.902170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:03.902591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:03.930927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ac3e0e7-c344-4b2f-93f1-6c0eb1ddc881 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043079 Sep 01 07:23:03.931456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 612/1233] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:03.993372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:03.995466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:04.001325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:04.001792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:04.002216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:04.002882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:04.003318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:04.004297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:04.028582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:04.033885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-019226b2-5231-421a-bad1-b3b3e9f4a03a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Sep 01 07:23:04.034420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 622/1234] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:04.109196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:04.111294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:04.118213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:04.118694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:04.119131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:04.119823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:04.120276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:04.120699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:04.149683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95006c18-dfb8-423c-9380-7c7c137b4b93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Sep 01 07:23:04.150235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 613/1235] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:04.942956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:04.945184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:04.951897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:04.952373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:04.952805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:04.953515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:04.953965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:04.954382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:04.983493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d7059f7-b60e-4392-b093-6f724cb07a42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045177 Sep 01 07:23:04.984031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 623/1236] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:05.045913 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:05.048071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:05.054508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:05.054988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:05.055422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:05.056105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:05.056556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:05.056976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:05.084377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e7ec988-7283-4b15-a8c4-0ac2725f233a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042344 Sep 01 07:23:05.084910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 614/1237] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:05.162391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:05.164478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:05.170369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:05.170860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:05.171286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:05.171966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:05.172413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:05.172835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:05.201447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03c45d62-7dde-49b1-8eee-1fb75d0a33d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043630 Sep 01 07:23:05.201991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 624/1238] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:05.995758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:05.998008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:06.000286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=86 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:06.005393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:06.005920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:06.006307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:06.007000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:06.007448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:06.007869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:06.037211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9e89349-b884-4749-8a3d-4d080d0bf810 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045413 Sep 01 07:23:06.037747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 615/1239] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:06.096561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:06.099408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:06.105811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:06.106275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:06.106697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:06.107368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:06.107808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:06.108218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:06.135646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6cd5f144-8c5a-4906-8aab-b48e225a0610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042934 Sep 01 07:23:06.136168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 625/1240] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:06.213965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:06.216065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:06.221889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:06.222369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:06.223434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:06.224125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:06.224578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:06.225001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:06.254463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-69971c39-d62f-48a7-b4c0-2467238311fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Sep 01 07:23:06.255000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 616/1241] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:07.049450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:07.052075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:07.057983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:07.058453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:07.058881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:07.059553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:07.059992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:07.060406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:07.089157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b5a63ed-2bca-4f93-85fd-b1e63e266400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043798 Sep 01 07:23:07.089699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 626/1242] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:07.147913 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:07.150118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:07.156349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:07.156831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:07.157314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:07.158002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:07.158455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:07.158882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:07.187559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-91d53606-9a8a-4876-8d86-f59275437733 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043472 Sep 01 07:23:07.188034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 617/1243] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:07.266553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:07.268671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:07.275016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:07.275492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:07.275920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:07.276594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:07.277035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:07.277474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:07.306640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ccb669e-6b11-41f4-8859-4e21d877b26c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Sep 01 07:23:07.307185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 627/1244] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:08.101779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:08.103898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:08.109780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:08.110257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:08.110691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:08.111373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:08.111825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:08.112274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:08.126271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:08.141763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a672e96c-0e24-4424-a0f6-717555cf5890 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044509 Sep 01 07:23:08.142302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 618/1245] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:08.200208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:08.202376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:08.208278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:08.208739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:08.209185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:08.209853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:08.210291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:08.210702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:08.239588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b1bb514-efa9-43e6-8cb2-e204cebe999e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Sep 01 07:23:08.240126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 628/1246] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:08.318526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:08.320627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:08.326994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:08.327475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:08.327912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:08.328596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:08.329049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:08.329499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:08.358774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-949a093a-f034-4c01-8c8d-7b6ee9aa6747 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Sep 01 07:23:08.359251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 619/1247] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:09.153450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:09.155610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:09.157888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=86 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:09.163365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:09.163833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:09.164259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:09.164930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:09.165396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:09.165808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:09.196743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e180a6a3-0b27-435e-b518-2e3677c074c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047154 Sep 01 07:23:09.197320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 629/1248] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:09 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:09.251101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:09.253188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:09.259662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:09.260147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:09.260579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:09.261296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:09.261748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:09.262169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:09.291840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a02e41d-b98d-4c4c-8c99-1eb54af4b5d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Sep 01 07:23:09.292391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 620/1249] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:09.370546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:09.372736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:09.378545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:09.379593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:09.380030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:09.380705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:09.381170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:09.381593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:09.409918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec48b1b6-13a7-47e2-ab97-2b549a838a83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043281 Sep 01 07:23:09.410511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 630/1250] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:10.208792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:10.211097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:10.218235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:10.218718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:10.219153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:10.219849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:10.220293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:10.220713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:10.251157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-61a404c8-09e5-4bb9-8b8c-42bb1c864e27 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046834 Sep 01 07:23:10.251709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 621/1251] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:10.304798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:10.306972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:10.313395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:10.313873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:10.314305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:10.314984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:10.315426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:10.315844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:10.345049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1b17aeb9-34e4-48c3-8538-871bbd7df6e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Sep 01 07:23:10.345623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 631/1252] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:10.421998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:10.424161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:10.431741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:10.432396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:10.433197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:10.434110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:10.434574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:10.435006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:10.464965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0a3a809-c6b0-468f-9125-0952c61aa5ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046848 Sep 01 07:23:10.465546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 622/1253] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:11.264215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:11.266362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:11.272229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:11.272701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:11.273150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:11.273830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:11.274273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:11.274688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:11.304029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-90191da3-af42-4e1a-b5bd-f74eda300299 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044010 Sep 01 07:23:11.304507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 632/1254] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:11.357189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:11.359350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:11.365672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:11.366154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:11.366595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:11.367282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:11.367737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:11.368169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:11.396631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b46cbeb-675e-4107-9c1e-cb89dd705691 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Sep 01 07:23:11.397192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 623/1255] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:11.477634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:11.479738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:11.485949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:11.486420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:11.486845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:11.487510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:11.487947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:11.488871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:11.517734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0483e05b-a74a-4eb4-8e73-6c7b3ad8a21c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Sep 01 07:23:11.518270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 633/1256] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:12.316136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:12.318866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:12.324754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:12.325209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:12.325640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:12.326316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:12.326759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:12.327175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:12.355213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-16cc7c93-9b0f-4ae8-bee6-3af4097b9446 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043006 Sep 01 07:23:12.355728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 624/1257] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:12.408453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:12.410605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:12.416458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:12.416930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:12.417403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:12.418085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:12.418528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:12.418943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:12.451195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d26f3b9c-3b02-44a7-a103-2e63c987f075 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046647 Sep 01 07:23:12.451757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 634/1258] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:12.530113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:12.532257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:12.539093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:12.539575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:12.540014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:12.540702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:12.541196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:12.541626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:12.570874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a1a7d5e0-4415-4708-a3c7-7a776fe01a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Sep 01 07:23:12.571414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 625/1259] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:13.367444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:13.369497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:13.375762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:13.376244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:13.376669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:13.377411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:13.377854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:13.378267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:13.408804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9fe505d-0e73-4ee5-9e6c-cee1344c632b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045410 Sep 01 07:23:13.409504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 635/1260] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:13.463909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:13.466065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:13.472017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:13.472493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:13.472957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:13.473682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:13.474130 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:13.474547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:13.502153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22751dd9-e506-4d05-a4f4-dd9cb5367abc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 Sep 01 07:23:13.502685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 626/1261] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:13.581970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:13.584719 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:13.590527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:13.591006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:13.591435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:13.592112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:13.592555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:13.592972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:13.621641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1067ea40-c3e5-4473-9017-954845876620 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Sep 01 07:23:13.622110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 636/1262] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:14.421162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:14.423255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:14.430149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:14.430631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:14.431064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:14.431751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:14.432202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:14.432633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:14.461449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81c3c982-2524-49f8-8def-7b57d660a118 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044285 Sep 01 07:23:14.462196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 627/1263] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:14.515125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:14.517277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:14.523575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:14.524042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:14.524464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:14.525157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:14.525596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:14.526010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:14.554931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-084215fe-6b36-4ed6-8784-d372ab547d17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Sep 01 07:23:14.555462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 637/1264] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:14.634512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:14.636672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:14.642793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:14.643277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:14.643715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:14.644405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:14.644857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:14.645316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:14.673743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b05f5b5e-0d70-4dc7-aa55-c7e4f18a7e74 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Sep 01 07:23:14.674226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 628/1265] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:15.474520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:15.476571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:15.482330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:15.482799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:15.483241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:15.483918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:15.484354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:15.484955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:15.515275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47144805-1a26-4bcc-b2ce-29f76dac8b00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045433 Sep 01 07:23:15.515916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 638/1266] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:23:15.567564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:15.569732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:15.576064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:15.576539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:15.576970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:15.577689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:15.579088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:15.579520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:15.608519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-445c9555-7b13-4450-a947-058397e07204 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Sep 01 07:23:15.609062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 629/1267] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:15.686175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:15.688311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:15.695138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:15.695625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:15.696047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:15.696732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:15.697197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:15.697618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:15.713466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:15.730166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02e94bc8-1e5f-4f88-b60f-b67b6b32a32d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047819 Sep 01 07:23:15.730647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 639/1268] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:16.528100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:16.530309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:16.536709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:16.537211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:16.537647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:16.538332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:16.538781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:16.539206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:16.567618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-984cd04c-661f-453f-8f3a-2196e1b8c70a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043610 Sep 01 07:23:16.568200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 630/1269] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:16.620745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:16.622934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:16.628896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:16.629401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:16.629833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:16.630516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:16.631341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:16.631341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:16.659942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-add3ad26-ce76-4ae1-980a-9b5e914767cc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Sep 01 07:23:16.661067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 640/1270] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:16.742200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:16.744362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:16.750603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:16.751083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:16.751513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:16.752195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:16.752663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:16.753064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:16.782802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-11733ece-26c1-4399-b465-50b671873739 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Sep 01 07:23:16.783288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 631/1271] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:17.579883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:17.582288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:17.588406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:17.588883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:17.589349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:17.590036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:17.590483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:17.590900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:17.619992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-908e8b09-6767-414d-9fea-25294ad56330 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044053 Sep 01 07:23:17.620540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 641/1272] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:17.672742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:17.675306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:17.681854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:17.682340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:17.682781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:17.683592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:17.684055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:17.684484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:17.713326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25e011c4-e881-4967-bcdb-81d9a5d00118 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 01 07:23:17.713879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 632/1273] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:17.795572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:17.797730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:17.804161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:17.804626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:17.805047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:17.805742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:17.806181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:17.806594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:17.835055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9182096-ea3c-4369-9d9a-f325b5d0e89f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Sep 01 07:23:17.835594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 642/1274] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:18.632152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:18.634311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:18.640973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:18.641483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:18.641918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:18.642605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:18.643058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:18.643477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:18.672877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6bd7475e-cbad-408d-abcb-cfaa8b93c356 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044682 Sep 01 07:23:18.673508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 633/1275] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:18.725342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:18.727454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:18.733821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:18.734296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:18.734725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:18.735399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:18.735841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:18.736257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:18.764851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ed5c083-0b22-45ee-be4c-2f1fd69f1bf5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044022 Sep 01 07:23:18.765430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 643/1276] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:18.847020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:18.849801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:18.855541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:18.856015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:18.856511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:18.857145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:18.857592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:18.858010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:18.886312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9b72ec65-8feb-40b4-b879-27a8d56a3acd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043243 Sep 01 07:23:18.886845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 634/1277] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:19.685370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:19.687522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:19.693448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:19.693923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:19.694352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:19.695030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:19.695474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:19.695888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:19.724350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-40e35970-14e7-4660-8a54-857c8015aa4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043066 Sep 01 07:23:19.724883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 644/1278] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:19.776957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:19.779122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:19.785459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:19.786449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:19.786884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:19.787570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:19.788022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:19.788447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:19.791995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:19.816786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9f41de5-ed4b-4fc9-8564-f6957b045d7d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Sep 01 07:23:19.817371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 635/1279] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:19.898798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:19.900910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:19.907212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:19.907842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:19.908275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:19.908950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:19.909416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:19.909828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:19.939318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb9ce7df-6987-4212-88c4-cf4608e1a1f1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Sep 01 07:23:19.939796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 645/1280] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:20.738421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:20.741036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:20.747054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:20.747531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:20.747965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:20.748642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:20.749090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:20.749535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:20.779565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a13aafe-aea5-4fe0-855b-a287f8faaa9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045051 Sep 01 07:23:20.780120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 636/1281] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:20.828644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:20.830817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:20.836722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:20.837228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:20.837666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:20.838353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:20.838800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:20.839222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:20.868154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dab92ef2-be33-44e2-9fe3-3387209999a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Sep 01 07:23:20.868695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 646/1282] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:20.951469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:20.953575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:20.959880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:20.960359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:20.960795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:20.961498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:20.961948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:20.962368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:20.990920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c707d8e-a0fc-4152-bb35-ec6ba20e49ab tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Sep 01 07:23:20.991452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 637/1283] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:21.792528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:21.794730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:21.801288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:21.801770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:21.802198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:21.802887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:21.803332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:21.803749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:21.836753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd05abca-3781-4a06-ac51-f6acc82d05b9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048214 Sep 01 07:23:21.837450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 647/1284] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:21.881181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:21.883533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:21.890388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:21.890946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:21.891383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:21.892115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:21.892566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:21.893142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:21.922736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-609873f9-62d7-47d5-8f14-45616f3d0ce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046382 Sep 01 07:23:21.923280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 638/1285] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:22.002936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:22.005650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:22.011615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:22.012093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:22.012560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:22.013286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:22.013734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:22.014468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:22.047149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b2b999b-d4f2-40db-be0b-1f207bff788a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048134 Sep 01 07:23:22.047711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 648/1286] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:22.849865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:22.851995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:22.858415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:22.858894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:22.859325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:22.860006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:22.860455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:22.860876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:22.889941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a70be78-f533-4bd6-82eb-a3e97b3dca3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044610 Sep 01 07:23:22.890520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 639/1287] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:22.934706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:22.936830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:22.943359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:22.943831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:22.944275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:22.944957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:22.945438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:22.945858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:22.975137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85fe3ca7-cfb3-45e4-81ab-3501345bbcaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Sep 01 07:23:22.975682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 649/1288] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:23.059976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:23.062124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:23.068177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:23.068669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:23.069107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:23.069829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:23.070279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:23.070702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:23.101426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-260352dc-e257-4c57-aba0-adb362b789c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Sep 01 07:23:23.101983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 640/1289] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:23.902093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:23.904213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:23.910196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:23.910672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:23.911096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:23.911775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:23.912213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:23.912626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:23.945231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5bf2a93f-98a8-4c8a-b82b-5fb6b94505ee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047020 Sep 01 07:23:23.945884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 650/1290] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:23.987398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:23.990131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:23.996497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:23.996975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:23.997445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:23.998125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:23.998576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:23.998994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:24.027793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e9d095f8-a7fb-4cda-82db-46040710abd8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Sep 01 07:23:24.028332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 641/1291] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:23:24.113371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:24.116056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:24.121842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:24.122311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:24.122735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:24.123409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:24.123846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:24.124257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:24.152512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c50acac5-8f2c-448f-a7fd-04fbd501e0c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Sep 01 07:23:24.153040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 651/1292] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:24.958615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:24.960728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:24.966552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:24.967026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:24.967454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:24.968127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:24.968572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:24.968990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:24.997635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-abffff8b-f0cd-4c27-a377-7f865f6e90ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044006 Sep 01 07:23:24.998211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 642/1293] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:25.039783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:25.041961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:25.048511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:25.048982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:25.049435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:25.050115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:25.050554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:25.050974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:25.079464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-293e3698-eb75-4da9-86ff-bba341508bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Sep 01 07:23:25.079995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 652/1294] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:25.163453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:25.165607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:25.171517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:25.171994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:25.172430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:25.173130 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:25.173581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:25.174003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:25.202642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-430d8f12-078d-4ae7-acce-7ce845b2eae3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Sep 01 07:23:25.203186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 643/1295] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:26.010090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:26.012224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:26.018420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:26.018826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:26.019251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:26.019921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:26.020360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:26.020772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:26.049432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ae525f6-f11c-497a-a7fe-1e15f635ff6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043315 Sep 01 07:23:26.050028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 653/1296] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:23:26.091687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:26.093862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:26.100310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:26.100786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:26.101242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:26.101926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:26.102378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:26.102799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:26.131125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dc9b9a1f-58ed-4399-9c48-afa8834769c4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Sep 01 07:23:26.131655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 644/1297] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:26.214697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:26.216820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:26.222679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:26.223654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:26.224081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:26.224753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:26.225226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:26.225645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:26.254170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fcfeeff7-8e59-4ff9-9307-1ec920841b9b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Sep 01 07:23:26.254712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 654/1298] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:27.062267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:27.064416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:27.070760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:27.071247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:27.071682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:27.072363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:27.072814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:27.073265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:27.101681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8903fb17-18d1-43c2-aa5d-0b96b06af68f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043378 Sep 01 07:23:27.102255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 645/1299] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:27.143436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:27.145641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:27.151994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:27.152465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:27.152891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:27.153591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:27.154033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:27.154446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:27.182987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3071a50-0670-4083-b895-54049f2cbd4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Sep 01 07:23:27.183776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 655/1300] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:27.266456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:27.268645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:27.275035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:27.275514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:27.275948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:27.276627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:27.277074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:27.277521 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:27.306153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e2a63140-b61e-478a-bae8-5bce2e17ec46 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Sep 01 07:23:27.306695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 646/1301] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:28.113660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:28.115769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:28.121650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:28.122124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:28.122549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:28.123216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:28.123681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:28.124090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:28.126403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:28.153892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb3138cf-63a9-4062-9c35-b44dbd2573f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Sep 01 07:23:28.154504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 656/1302] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:28.194442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:28.196569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:28.202826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:28.203311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:28.203742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:28.204421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:28.204868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:28.205325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:28.234239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e2c8cfcb-30c5-482b-a603-c4a45ab64c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Sep 01 07:23:28.234775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 647/1303] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:28.319052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:28.321192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:28.327075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:28.327547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:28.327976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:28.328650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:28.329094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:28.329532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:28.358821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9382683-684c-43e8-b0e6-5d6e1cf22ed8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Sep 01 07:23:28.359371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 657/1304] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:29.166738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:29.168887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:29.174800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:29.175275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:29.175708 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:29.177020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:29.177495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:29.177921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:29.206104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9583d6d8-d8ed-479b-811b-33adddd8bd59 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043380 Sep 01 07:23:29.206700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 648/1305] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:29.246137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:29.248258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:29.254508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:29.254973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:29.255393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:29.256060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:29.256494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:29.256905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:29.285205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc96b9f2-0828-44d7-aa1d-b1131c557dd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 Sep 01 07:23:29.286244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 658/1306] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:29.371290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:29.373542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:29.380025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:29.380513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:29.380947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:29.381687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:29.382140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:29.382566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:29.416484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-850799b1-3459-447c-8569-176f8643e74a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049188 Sep 01 07:23:29.417175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 649/1307] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:30.218550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:30.221021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:30.226871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:30.227339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:30.227759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:30.228423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:30.228857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:30.229308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:30.260048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b17cbcf1-9ca3-4a33-873d-80ce007c522c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045682 Sep 01 07:23:30.260750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 659/1308] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:30.297957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:30.300081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:30.306908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:30.307389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:30.307826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:30.308514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:30.308964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:30.309424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:30.338243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-241cab47-67d9-4769-bd3b-2cd890ffe937 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Sep 01 07:23:30.338799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 650/1309] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:30.428753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:30.430897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:30.436732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:30.437235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:30.437663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:30.438336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:30.438774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:30.439187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:30.468175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4f87e27-b081-43f1-a270-1deaa7bab4b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Sep 01 07:23:30.468758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 660/1310] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:31.273254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:31.275394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:31.281335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:31.281827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:31.282269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:31.282961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:31.283417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:31.283844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:31.308881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:31.313747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2df8196-931e-42a5-8d57-4b867f7ddd14 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045096 Sep 01 07:23:31.314298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 651/1311] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:31.350652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:31.352818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:31.359193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:31.359654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:31.360077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:31.360741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:31.361220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:31.361634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:31.390441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-26b1939f-9ba9-476a-b726-95c39ae3c686 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Sep 01 07:23:31.390980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 661/1312] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:23:31.480345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:31.482590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:31.488494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:31.488998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:31.489464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:31.490157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:31.490619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:31.491048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:31.521288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26269fe0-b0ba-4501-aed0-377809fce5bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Sep 01 07:23:31.521828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 652/1313] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:32.326821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:32.328924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:32.334956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:32.335420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:32.335841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:32.336507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:32.336941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:32.337382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:32.366394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89d41a5f-8344-4f2d-8b9b-810c4b0b99c6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043710 Sep 01 07:23:32.367240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 662/1314] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:32.402428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:32.404602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:32.411557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:32.412026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:32.412452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:32.413152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:32.413594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:32.414010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:32.441931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6d7fed52-d682-44e1-b565-e41fe6cfe7ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 Sep 01 07:23:32.442467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 653/1315] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:32.533144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:32.535300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:32.541950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:32.542413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:32.542831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:32.543497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:32.543931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:32.544340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:32.572744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f5eed3f-b378-462e-b606-c55bac07b254 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Sep 01 07:23:32.573306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 663/1316] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:33.378817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:33.381573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:33.387462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:33.387937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:33.388412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:33.389361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:33.389805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:33.390221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:33.418742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b22e2b72-4e16-45c7-874b-349819aa3c2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043956 Sep 01 07:23:33.419386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 654/1317] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:33.453599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:33.455758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:33.462072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:33.462545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:33.462978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:33.463655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:33.464100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:33.464518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:33.492833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b495215-fa8c-4ee9-a8a2-ca03e36c004e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Sep 01 07:23:33.493412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 664/1318] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:33.583977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:33.586144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:33.592026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:33.592502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:33.592933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:33.593641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:33.594084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:33.594500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:33.624213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-90f9c970-17d3-484f-8d11-1c1e8243cc22 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Sep 01 07:23:33.624756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 655/1319] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:34.431061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:34.433188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:34.439015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:34.439482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:34.439904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:34.440569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:34.441006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:34.441443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:34.471617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d79866ea-5527-4093-8581-b4363ec2acb7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044495 Sep 01 07:23:34.472272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 665/1320] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:34.504842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:34.507016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:34.513452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:34.513934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:34.514638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:34.515325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:34.515787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:34.516214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:34.548853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0720ba44-bf36-4bfc-af65-7972d4456935 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048386 Sep 01 07:23:34.549449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 656/1321] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:34.636650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:34.638893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:34.645234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:34.645711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:34.646149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:34.646818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:34.647261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:34.647677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:34.675948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a604166-eb13-41e6-895a-6150c0e7fcf9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043258 Sep 01 07:23:34.676998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 666/1322] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:35.483866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:35.486026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:35.491886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:35.492361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:35.492981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:35.493701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:35.494149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:35.494569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:35.526091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ece38ef8-e718-48f5-99b9-a49024c2c03f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046224 Sep 01 07:23:35.526735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 657/1323] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:35.561218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:35.563690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:35.570009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:35.570472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:35.570892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:35.571559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:35.571995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:35.572408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:35.602143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14a52ca5-abb8-42a6-99fe-63fe3b691577 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Sep 01 07:23:35.602688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 667/1324] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:35.687817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:35.689951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:35.695750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:35.696222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:35.696654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:35.697360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:35.697807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:35.698221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:35.728209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7bdca1db-a318-4c24-8dbb-87150d35e321 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Sep 01 07:23:35.728760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 658/1325] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:36.538505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:36.540653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:36.546499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:36.546966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:36.547389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:36.548051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:36.548484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:36.548895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:36.577997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-861a81a1-8102-46c5-952c-d2009675c2d5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044013 Sep 01 07:23:36.578592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 668/1326] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:36.613230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:36.616161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:36.619644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:36.626252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:36.626738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:36.627176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:36.627869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:36.628320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:36.629369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:36.658114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28e0a5a1-ad34-46a4-af4e-85d7574a6191 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048775 Sep 01 07:23:36.658664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 659/1327] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:36.740485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:36.742633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:36.748498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:36.748976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:36.749439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:36.750119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:36.750565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:36.750984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:36.781183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bcd9ec4-b30b-4421-b032-43e08b15184a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045200 Sep 01 07:23:36.781730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 669/1328] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:37.590442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:37.592603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:37.598683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:37.599165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:37.599601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:37.600290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:37.600738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:37.601178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:37.630997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5441e20f-cfdb-40a8-a93b-68833bd450ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044488 Sep 01 07:23:37.631632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 660/1329] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:37.670712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:37.672858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:37.680161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:37.680639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:37.681188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:37.681998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:37.682441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:37.682860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:37.712600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0249e24d-baa8-4158-9882-2c123289f84a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Sep 01 07:23:37.713152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 670/1330] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:37.793681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:37.795819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:37.802425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:37.802912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:37.803349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:37.804044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:37.804502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:37.804931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:37.834852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c7750034-536f-435f-b116-ebe6245cbb99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044861 Sep 01 07:23:37.835770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 661/1331] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:38.643772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:38.648380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:38.654308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:38.654774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:38.655195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:38.655868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:38.656302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:38.656711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:38.685554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cbceeb72-2623-4113-980a-34e7568ce6eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046101 Sep 01 07:23:38.686159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 671/1332] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:38.724296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:38.726581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:38.732987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:38.733494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:38.733923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:38.734609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:38.735054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:38.735470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:38.764645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f05e2ca0-0f04-4f24-b334-e93aea2d990f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Sep 01 07:23:38.765222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 662/1333] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:38.847676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:38.850355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:38.856216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:38.856688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:38.857137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:38.857823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:38.858269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:38.858686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:38.883180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:38.888238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e4b3de3-1f9f-486d-a8d2-4cc58ade0545 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Sep 01 07:23:38.888787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 672/1334] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:39.698414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:39.700540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:39.706471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:39.706952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:39.707392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:39.708652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:39.709100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:39.709548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:39.737929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53d26dfd-1833-44aa-b156-8641fcf248a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043550 Sep 01 07:23:39.738526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 663/1335] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:39.777387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:39.779490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:39.781726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:39.786717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:39.787182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:39.787601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:39.788264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:39.788700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:39.789135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:39.817447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32e89fa3-ccb2-44d2-9632-8b002998a7df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 Sep 01 07:23:39.817987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 673/1336] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:39.900446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:39.902613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:39.908647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:39.909158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:39.909603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:39.910292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:39.910748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:39.911177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:39.940642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3d1b21f4-aadc-4943-ba60-6f0ac0d47c8f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 Sep 01 07:23:39.941201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 664/1337] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:40.750309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:40.752455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:40.759047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:40.759516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:40.759935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:40.760602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:40.761035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:40.761477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:40.790426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8aa4506-069a-44af-9071-0812380199f9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044154 Sep 01 07:23:40.790990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 674/1338] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:40.829437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:40.831579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:40.837917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:40.838394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:40.838823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:40.839505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:40.839952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:40.840367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:40.869399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa2522a0-b15a-4feb-9b03-c18f75499d08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Sep 01 07:23:40.870130 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 665/1339] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:40.953358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:40.955386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:40.961218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:40.961685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:40.962110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:40.962778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:40.963215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:40.963626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:40.992920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37d3c212-49a0-49fc-b4a7-da9abe21cdd4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Sep 01 07:23:40.993488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 675/1340] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:41.802970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:41.805822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:41.811694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:41.812256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:41.812689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:41.813412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:41.813861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:41.814280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:41.843147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3a5de65b-4de8-4962-bd0a-2b4f363f94fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044568 Sep 01 07:23:41.843744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 666/1341] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:41.881619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:41.884074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:41.890854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:41.891216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:41.891644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:41.892325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:41.892772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:41.893222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:41.922540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd260b98-624b-470b-93f2-262077f139e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Sep 01 07:23:41.923085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 676/1342] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:42.004835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:42.007010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:42.012810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:42.013321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:42.013753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:42.014683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:42.015128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:42.015547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:42.043975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-914b1290-e0fb-4087-b2ad-141a4c0361ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Sep 01 07:23:42.044507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 667/1343] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:42.855544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:42.857677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:42.863534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:42.864543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:42.864967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:42.865659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:42.866100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:42.866507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:42.896155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3382ca67-d6af-481f-a860-84b0346ec0df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044539 Sep 01 07:23:42.896738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 677/1344] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:23:42.935562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:42.937735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:42.944836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:42.945363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:42.945798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:42.946526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:42.946986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:42.947410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:42.960830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:42.976409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-051f4cd5-1092-4e4b-8008-d64d8ab1898f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Sep 01 07:23:42.976960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 668/1345] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:43.056694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:43.058853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:43.064616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:43.065083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:43.065538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:43.066205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:43.066639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:43.067704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:43.095581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67936b0e-45b6-44d7-b26f-71337ec8e29c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042963 Sep 01 07:23:43.096106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 678/1346] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:43.907953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:43.910094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:43.916644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:43.917140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:43.917591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:43.918273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:43.918722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:43.919138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:43.947583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7362f2e-2ed9-4281-b2f5-8f411e60ee6e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043593 Sep 01 07:23:43.948395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 669/1347] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:43.988519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:43.990743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:43.997220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:43.997693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:43.998123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:43.998805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:43.999249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:43.999672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:44.029254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ba859908-135b-40f6-8f7d-da0b92f2c457 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Sep 01 07:23:44.029798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 679/1348] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:44.107512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:44.109741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:44.115537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:44.116010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:44.116443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:44.117136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:44.117587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:44.118008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:44.147593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-70104b28-6675-4be3-9746-f387fa87a30b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Sep 01 07:23:44.148134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 670/1349] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:44.959523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:44.961611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:44.967555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:44.968031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:44.968462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:44.969253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:44.969684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:44.970010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:45.000470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bca905e6-1b21-4d2d-84b8-56b8df15524e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044969 Sep 01 07:23:45.001064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 680/1350] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:45.041932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:45.044081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:45.050386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:45.050862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:45.051957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:45.052644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:45.053095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:45.053538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:45.080923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1b57aef-e85c-40e1-9f39-d94c32021de4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Sep 01 07:23:45.081483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 671/1351] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:45.159488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:45.162275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:45.168009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:45.168476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:45.168902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:45.169598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:45.170039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:45.170451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:45.198576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d066d053-bb35-4fcf-823b-98ce28b9d4de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Sep 01 07:23:45.199104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 681/1352] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:46.011798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:46.013969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:46.020005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:46.020424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:46.020858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:46.021579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:46.022031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:46.022452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:46.050911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bfaf67fa-c2c8-4fad-a1c0-1ce31059a296 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043057 Sep 01 07:23:46.052104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 672/1353] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:46.092295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:46.094536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:46.100827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:46.101340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:46.101774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:46.102456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:46.102906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:46.103328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:46.132858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c0ee3a6-a7eb-4d59-8606-5c71db5a1126 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Sep 01 07:23:46.133424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 682/1354] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:46.210905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:46.213032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:46.219095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:46.219577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:46.220038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:46.220750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:46.221246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:46.221667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:46.250844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe0dc29a-6b62-4fbe-809d-91c7ff29591b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Sep 01 07:23:46.251379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 673/1355] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:47.063740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:47.065856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:47.072132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:47.072606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:47.073019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:47.073711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:47.074150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:47.074558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:47.103400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4543606-2c14-477f-a62c-7f31aaf6d21b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043717 Sep 01 07:23:47.103997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 683/1356] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:47.145803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:47.147915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:47.154144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:47.154621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:47.155050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:47.155725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:47.156176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:47.156594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:47.184111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36740136-8429-4eab-b3b2-fc8da2974b13 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042924 Sep 01 07:23:47.184630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 674/1357] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:47.262418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:47.264822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:47.271386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:47.271792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:47.272220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:47.272896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:47.273371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:47.273785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:47.301949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f21a9a9c-f050-44f2-86e0-243242571969 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043439 Sep 01 07:23:47.302489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 684/1358] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:48.115564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:48.117730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:48.123540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:48.124019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:48.124454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:48.125152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:48.125604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:48.126022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:48.154833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-902fa7ff-869b-4212-99b1-8b667ffbcc84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043240 Sep 01 07:23:48.155406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 675/1359] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:48.196058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:48.198193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:48.204524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:48.204986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:48.205445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:48.206115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:48.206549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:48.206960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:48.235869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a37807ab-25cd-49bb-85ab-7904ddacf3b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043788 Sep 01 07:23:48.236401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 685/1360] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:48.314136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:48.316312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:48.322282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:48.322760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:48.323192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:48.323908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:48.324364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:48.324788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:48.354978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bd513b83-ee27-41a8-ad4d-4ad987081973 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Sep 01 07:23:48.355527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 676/1361] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:49.166841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:49.168933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:49.174761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:49.175230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:49.175661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:49.176329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:49.176766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:49.177707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:49.206698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7991652-3f5d-483d-bbc3-1045f85c1c15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043792 Sep 01 07:23:49.207298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 686/1362] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:49.250171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:49.252324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:49.258914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:49.259391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:49.259824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:49.261514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:49.261514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:49.261514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:49.290404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c568bf7b-5f21-42f8-a192-e955b064ea34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Sep 01 07:23:49.290955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 677/1363] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:49.367498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:49.369568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:49.375423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:49.375891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:49.376312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:49.376983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:49.377456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:49.377872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:49.406802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79ec0349-44f3-42c5-ade5-27f2ebd41c82 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Sep 01 07:23:49.407349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 687/1364] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:50.218797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:50.220978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:50.227125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:50.227615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:50.228059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:50.228758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:50.229248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:50.229706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:50.259235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3aa0853-484c-4859-b1cc-7fb10ef0bdd8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044351 Sep 01 07:23:50.259819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 678/1365] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:50.301994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:50.304180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:50.310471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:50.310948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:50.311383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:50.312064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:50.312512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:50.312933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:50.342086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a16f8a65-3110-4c93-a80c-3db697d25841 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Sep 01 07:23:50.342639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 688/1366] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:50.418487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:50.420527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:50.426411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:50.427499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:50.427930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:50.428605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:50.429051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:50.429493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:50.458756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8bb555cc-54c6-4bab-8a11-766d5e9e3389 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Sep 01 07:23:50.459294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 679/1367] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:51.271822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:51.274028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:51.279918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:51.280394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:51.280828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:51.281533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:51.281976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:51.282401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:51.296304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:51.312056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a11a0140-e22c-4c8a-a97b-15e31e738a9f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044662 Sep 01 07:23:51.312700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 689/1368] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:51.354926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:51.357043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:51.363374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:51.363858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:51.364280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:51.364957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:51.365448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:51.365867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:51.394064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d20e35a3-e8d7-4de3-9d86-9f66884d4fe7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Sep 01 07:23:51.394542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 680/1369] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:51.470588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:51.472755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:51.479294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:51.479759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:51.480185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:51.480854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:51.481330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:51.481741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:51.510305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75e598f9-4ff8-4e5d-a161-a869d8c10923 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Sep 01 07:23:51.510839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 690/1370] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:52.324296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:52.326496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:52.332760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:52.333340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:52.333784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:52.334480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:52.334934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:52.335362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:52.365089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e195a5d1-bc82-4535-b28d-a9dc47a980cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044208 Sep 01 07:23:52.365706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 681/1371] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:52.405676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:52.407849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:52.414610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:52.415084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:52.415515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:52.416189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:52.416633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:52.417051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:52.445516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8ed6952-a9aa-4b03-b283-50c2fa0c5993 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Sep 01 07:23:52.446074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 691/1372] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:52.522783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:52.524960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:52.531132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:52.531620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:52.532057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:52.532748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:52.533230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:52.533658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:52.562955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-94b3b1a5-6aeb-4c8d-acb2-d1468c21619b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Sep 01 07:23:52.563497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 682/1373] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:53.377302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:53.379412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:53.385487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:53.385968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:53.386401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:53.387077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:53.387519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:53.387959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:53.417881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2dc6889e-2f1c-4502-b883-5cbdb29e03d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044573 Sep 01 07:23:53.418485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 692/1374] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:53.458027 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:53.460610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:53.466922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:53.467404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:53.467840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:53.468522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:53.468977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:53.469423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:53.498959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d723f406-36dc-4fad-98e5-356029775d80 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Sep 01 07:23:53.499500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 683/1375] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:53.574989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:53.577147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:53.582991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:53.583963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:53.584389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:53.585061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:53.585540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:53.585971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:53.614816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4b96ffdb-98d6-4e8f-8210-4a6171e0adf2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Sep 01 07:23:53.615350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 693/1376] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:54.430308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:54.432425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:54.438361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:54.438832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:54.439261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:54.439969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:54.440413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:54.440828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:54.470453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d0e02ddf-bcd1-4aa2-a35f-712c31110577 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044070 Sep 01 07:23:54.471452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 684/1377] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:54.511650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:54.513814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:54.520343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:54.521565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:54.521987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:54.522671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:54.523120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:54.523542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:54.552119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b2b74ac-3785-4c09-a18e-8d063f43ab32 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Sep 01 07:23:54.552666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 694/1378] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:54.626820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:54.629024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:54.635406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:54.635955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:54.636431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:54.637214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:54.637663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:54.638085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:54.642271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:23:54.668625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9fad18a1-9c71-45f2-981a-ed40ff07be66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Sep 01 07:23:54.669304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 685/1379] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:55.484053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:55.486252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:55.492257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:55.492675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:55.493103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:55.493801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:55.494246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:55.494666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:55.524373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bccbbf8b-9e91-46b5-a0bb-28c0cde7a55b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044273 Sep 01 07:23:55.524982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 695/1380] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:55.564683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:55.566852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:55.573259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:55.573737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:55.574167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:55.574843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:55.575288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:55.575705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:55.604454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0322b61b-2560-434b-bf52-47809c12ec34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Sep 01 07:23:55.604988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 686/1381] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:55.680731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:55.682947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:55.688804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:55.689323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:55.689754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:55.690427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:55.690866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:55.691288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:55.719869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c68f69a-78e5-4c6b-bd6a-e1ab36fb1b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Sep 01 07:23:55.720401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 696/1382] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:56.299049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:56.299541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:56.305370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:56.305849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:56.306278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:56.306956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:56.307404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:56.307824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:56.388394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lazy-loading 'services' on Instance uuid 9e1d3249-4d55-40bc-a993-ff010dccc5d5 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:23:56.459823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e24f1923-88e9-42cb-8242-673a2c2352c7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5/os-volume_attachments/4c7d4fdd-b59d-4ae0-af1d-1833119cdd69" status: 202 len: 0 microversion: 2.1 time: 0.164476 Sep 01 07:23:56.460391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 687/1383] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:23:56 2022] DELETE /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5/os-volume_attachments/4c7d4fdd-b59d-4ae0-af1d-1833119cdd69 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:23:56.536502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:56.538972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:56.545431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:56.545904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:56.546334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:56.547020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:56.547461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:56.547878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:56.578029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea2357d3-942b-45ff-94f0-03fb21619bcc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045587 Sep 01 07:23:56.578584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 697/1384] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:56.618356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:56.620549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:56.626527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:56.627005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:56.627436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:56.628112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:56.628561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:56.628980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:56.658247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a123f67c-b6a7-4934-910a-c36b54df8889 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Sep 01 07:23:56.658792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 688/1385] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:56.731738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:56.733874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:56.740373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:56.740844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:56.741305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:56.741978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:56.742417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:56.742831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:56.772054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b21b16c2-7d20-4dbe-9826-0c8de6f6fb02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Sep 01 07:23:56.772611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 698/1386] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:57.590242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:57.592354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:57.598148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:57.598648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:57.599057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:57.599735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:57.600189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:57.600610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:57.628561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53e22275-a9ad-4520-877b-fdfa010521bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042235 Sep 01 07:23:57.629138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 689/1387] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:57.670155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:57.672304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:57.678611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:57.679082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:57.679515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:57.680190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:57.680630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:57.681046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:57.710011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e848da0c-76e0-4abf-a7ac-7decacf8c20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Sep 01 07:23:57.710555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 699/1388] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:57.783973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:57.786144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:57.792051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:57.792536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:57.792973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:57.793702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:57.794160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:57.794590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:57.823460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e46fff1-a619-45e0-9103-929c15bddf87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Sep 01 07:23:57.824003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 690/1389] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:58.641312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:58.643463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:58.649999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:58.650473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:58.650901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:58.651572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:58.652033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:58.652435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:58.681614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8747b2f5-35df-408e-80e8-2981cbbeaa4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044523 Sep 01 07:23:58.682251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 700/1390] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:58.721375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:58.723566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:58.730531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:58.731010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:58.731445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:58.732127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:58.732578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:58.733000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:58.761589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4dd9497d-0fb7-4405-bc0e-8acc3293dfc7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Sep 01 07:23:58.762139 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 691/1391] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:58.835969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:58.838130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:58.844022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:58.844535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:58.844966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:58.845733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:58.846182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:58.846606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:58.875460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a9d210c-c817-47b4-b477-071f143dc5e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Sep 01 07:23:58.875999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 701/1392] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:59.694360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:59.696461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:59.702246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:59.702727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:59.703157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:59.703832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:59.704277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:59.704695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:59.733040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7497263-68c7-4769-ad96-c46fc2ef4060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043185 Sep 01 07:23:59.733656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 692/1393] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:23:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:23:59.773596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:59.775783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:59.782095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:59.782576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:59.783004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:59.783679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:59.784124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:59.784537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:59.813387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96bf5593-bd9c-456a-b297-5555584678a3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Sep 01 07:23:59.813926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 702/1394] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:23:59.887431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:23:59.889753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:23:59.895564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:59.896051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:59.896470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:59.897166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:23:59.897616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:23:59.898036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:23:59.926484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fd7d0ba-f95b-450d-bc31-76d3994f64bc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043051 Sep 01 07:23:59.927691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 693/1395] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:23:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:00.744519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:00.746698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:00.752519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:00.752983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:00.753441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:00.754115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:00.754555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:00.754968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:00.785200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4598a64a-1141-4450-9a76-bf6795de9739 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044556 Sep 01 07:24:00.785910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 703/1396] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:00.825352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:00.827483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:00.834419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:00.834912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:00.835347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:00.836028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:00.836480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:00.836900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:00.864667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-630e5ee5-ecb1-4c9e-9560-1b1b82aef2ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 Sep 01 07:24:00.865768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 694/1397] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:00.940302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:00.942416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:00.948974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:00.949479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:00.949910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:00.950598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:00.951040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:00.951459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:00.979990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad7cf613-0b21-4f96-b589-7816d26fb146 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043659 Sep 01 07:24:00.980545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 704/1398] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:01.797646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:01.799932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:01.805862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:01.806348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:01.806789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:01.807481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:01.807970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:01.808395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:01.837617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f24e978-ca4d-40a6-af50-96ce9455e0a9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043875 Sep 01 07:24:01.838235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 695/1399] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:01.877267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:01.879426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:01.885440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:01.885921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:01.886353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:01.887035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:01.887480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:01.887901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:01.917432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2780e14a-38f0-46cb-9782-a1be7c57ff70 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Sep 01 07:24:01.918000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 705/1400] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:01.992045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:01.994210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:02.000208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:02.000634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:02.001077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:02.001801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:02.002260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:02.002688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:02.032788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0ab3b4f3-98bc-4afb-9f7b-8f06c67031b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044668 Sep 01 07:24:02.033363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 696/1401] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:02.850006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:02.852409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:02.858308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:02.858783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:02.859214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:02.859893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:02.860336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:02.860749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:02.864272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:02.891093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-671a95c3-e042-4123-a97f-c966b8448532 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045274 Sep 01 07:24:02.891707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 706/1402] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:02.929566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:02.931646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:02.938104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:02.938589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:02.939030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:02.939720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:02.940175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:02.940601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:02.969713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-35f8fc3f-8b1c-4177-a504-3daf2c39d5b0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Sep 01 07:24:02.970262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 697/1403] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:03.044484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:03.046661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:03.052524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:03.053001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:03.053473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:03.054154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:03.054598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:03.055017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:03.083701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6b5aa65-6d2d-4b40-856b-c62cc3938030 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Sep 01 07:24:03.084799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 707/1404] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:03.903425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:03.905648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:03.911435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:03.912655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:03.913090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:03.913799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:03.914242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:03.914656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:03.943645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2413502f-b48f-45aa-b4aa-b284ef4afb93 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044068 Sep 01 07:24:03.944263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 698/1405] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 07:24:03.981845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:03.983993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:03.990490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:03.991018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:03.991399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:03.992078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:03.992525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:03.992943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:04.021042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28cd1449-1048-4594-b5b3-b730e1476d97 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Sep 01 07:24:04.022134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 708/1406] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:04.096273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:04.098473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:04.104953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:04.105532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:04.105966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:04.106678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:04.107128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:04.107547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:04.135969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e01d1f59-600d-4da6-bf23-a147ed6e47f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Sep 01 07:24:04.136504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 699/1407] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:04.958120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:04.960235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:04.966050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:04.966522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:04.966947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:04.967626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:04.968062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:04.968561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:04.998507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d2c3001b-ebea-4eef-8ab0-7dc4ce9254be tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044260 Sep 01 07:24:04.999155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 709/1408] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:05.033636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:05.035764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:05.042498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:05.042979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:05.043414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:05.044099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:05.044583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:05.044999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:05.074132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49d28ef9-fefe-4053-9dfc-07ad73d60e20 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Sep 01 07:24:05.074672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 700/1409] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:05.148293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:05.150432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:05.156310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:05.156784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:05.157255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:05.157984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:05.158431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:05.158847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:05.188106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96f45781-7581-45d3-8286-a6c5d4e9f3aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Sep 01 07:24:05.188646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 710/1410] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:06.011331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:06.013593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:06.019707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:06.020122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:06.020553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:06.021910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:06.022432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:06.022861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:06.025340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:06.053315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78b1f086-adea-4e8b-adab-69b26a9b34f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045926 Sep 01 07:24:06.053929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 701/1411] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:06.086118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:06.088225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:06.094505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:06.094969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:06.095394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:06.096059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:06.096498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:06.096911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:06.125083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eba1e935-7788-41cd-90f7-a34d275f1d1c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Sep 01 07:24:06.125642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 711/1412] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:06.200281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:06.202438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:06.208345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:06.208821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:06.209284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:06.209961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:06.210412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:06.210831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:06.239487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a73eddeb-740b-43b3-8735-19268194d4ae tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Sep 01 07:24:06.240536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 702/1413] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:07.065474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:07.067610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:07.073491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:07.073969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:07.074404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:07.075095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:07.075543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:07.075962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:07.106548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1ac6e6b8-d54f-46be-823f-a952129db804 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045051 Sep 01 07:24:07.107231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 712/1414] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:07.136924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:07.139128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:07.141725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=88 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:07.147506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:07.147993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:07.148432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:07.149135 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:07.149593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:07.150019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:07.178444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da4d5cf0-9588-4af9-8d8c-e189ef53127a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Sep 01 07:24:07.178992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 703/1415] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:07.251783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:07.253940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:07.259927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:07.260385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:07.260823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:07.261542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:07.261991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:07.262411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:07.291712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0228637b-b4d3-4176-b54e-86a94e813624 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Sep 01 07:24:07.292197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 713/1416] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:08.119014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:08.120938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:08.126691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:08.127165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:08.127595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:08.128273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:08.128717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:08.129165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:08.159592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb382aa6-f49c-485a-8962-2e9ba100ac1a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044775 Sep 01 07:24:08.160243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 704/1417] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:08.190475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:08.192637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:08.199514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:08.199988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:08.200419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:08.201102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:08.201599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:08.202022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:08.231058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6a36e3a9-46b7-4b78-8908-0bab02eeb4eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Sep 01 07:24:08.231608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 714/1418] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:08.303462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:08.305632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:08.311448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:08.311924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:08.312356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:08.313036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:08.313581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:08.314003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:08.342655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e30a143-34ed-495e-9065-8bb198c7f387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Sep 01 07:24:08.343196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 705/1419] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:09.171629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:09.173795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:09.179818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:09.180298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:09.180733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:09.181445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:09.181893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:09.182312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:09.211748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46a7b5d6-09c3-4ceb-a896-69dc92097858 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044053 Sep 01 07:24:09.212340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 715/1420] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:09 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:09.243049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:09.245227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:09.251555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:09.252039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:09.252486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:09.253204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:09.253662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:09.254088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:09.285469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-52445b13-4d25-4e84-9418-bdb0055379dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046263 Sep 01 07:24:09.286026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 706/1421] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:09.354631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:09.356780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:09.362668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:09.363141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:09.363568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:09.364242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:09.364683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:09.365146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:09.393747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f553ada7-6b52-4870-a7c5-de221ceb31fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Sep 01 07:24:09.394278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 716/1422] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:10.224098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:10.226253 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:10.232197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:10.232710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:10.233169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:10.233869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:10.234314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:10.234729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:10.265081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3783648b-35a1-4f33-b704-8c80b4d5dd6f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044444 Sep 01 07:24:10.265726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 707/1423] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:10.298306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:10.300439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:10.302797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:10.307932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:10.308409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:10.308839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:10.309543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:10.309988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:10.310416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:10.339669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1807bcef-cd79-4d70-9b2f-a73929b6584d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Sep 01 07:24:10.340218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 717/1424] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:10.406170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:10.408297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:10.414247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:10.414722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:10.415150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:10.415831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:10.416277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:10.416695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:10.445263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-46712913-a5d8-4ee1-b724-17b1420294fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Sep 01 07:24:10.445804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 708/1425] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:11.276148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:11.278369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:11.284041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:11.284515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:11.284942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:11.285647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:11.286092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:11.286508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:11.316895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7b934b8-9467-47cd-8c07-855e283b2865 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044537 Sep 01 07:24:11.317551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 718/1426] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:11.351666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:11.353842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:11.360101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:11.360583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:11.361024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:11.361734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:11.362186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:11.362608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:11.390815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3ca1e70-9d4a-4f90-986e-4e853e289610 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Sep 01 07:24:11.391361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 709/1427] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:11.559721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:11.561894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:11.567867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:11.568365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:11.568800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:11.569519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:11.569968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:11.570386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:11.605260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea2cb427-d232-4073-ad25-d5f5b37b0387 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152328 Sep 01 07:24:11.605841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 719/1428] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:12.328262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:12.330344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:12.336344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:12.336824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:12.337292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:12.337985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:12.338437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:12.338858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:12.369065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2c9638f-8c52-44c6-872e-011db000f3ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044857 Sep 01 07:24:12.369676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 710/1429] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:12.402869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:12.405011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:12.411281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:12.411748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:12.412171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:12.412834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:12.413297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:12.413706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:12.441853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-753c334a-ab2c-4c88-b673-49407833310d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042935 Sep 01 07:24:12.442365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 720/1430] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:12.618049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:12.620120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:12.626150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:12.626690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:12.627170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:12.627861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:12.628315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:12.628744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:12.661690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6d18b8b2-da26-4af6-96e6-75932bfe5fe7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048252 Sep 01 07:24:12.662768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 711/1431] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:13.382032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:13.384152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:13.390557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:13.391036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:13.391467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:13.392193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:13.392638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:13.393055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:13.422688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7dc796c-586c-4de5-82ae-c89329e8e9b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045369 Sep 01 07:24:13.425598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 721/1432] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:13.456232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:13.458399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:13.465311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:13.465794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:13.466228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:13.466912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:13.467370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:13.467787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:13.495590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-476809f5-ac3c-495f-82ef-3637140cbe83 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Sep 01 07:24:13.496126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 712/1433] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:13.674232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:13.676272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:13.682868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:13.683341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:13.683771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:13.684749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:13.685238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:13.685876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:13.711361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:13.716451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46c74a8a-2013-4662-a875-a8ab5b78e95d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046190 Sep 01 07:24:13.716995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 722/1434] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:14.501687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:14.503980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:14.507620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:14.509775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:14.509998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:14.510481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:14.510911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:14.511598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:14.512045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:14.512459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:14.516573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:14.517246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:14.517675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:14.518411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:14.518849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:14.519260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:14.542844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d7f32cb6-8bd4-4811-a063-6cc542c6ed95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111914 Sep 01 07:24:14.543404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 713/1435] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:14.548560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed49547b-c7a3-4588-a4f6-4e8561b3cdec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044774 Sep 01 07:24:14.549104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 723/1436] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:14.728797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:14.730892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:14.736814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:14.737327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:14.737765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:14.738452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:14.738904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:14.739332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:14.770494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87c3ab5a-ab3b-4473-a534-4eac97f4e032 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Sep 01 07:24:14.771050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 714/1437] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:15.555605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:15.557803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:15.560460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:15.562693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:15.564347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:15.564827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:15.565292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:15.565987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:15.566450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:15.566889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:15.569650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:15.571397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:15.571397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:15.571397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:15.571715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:15.572113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:15.595638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52e16919-1419-463b-b6d8-142aed7ea116 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044577 Sep 01 07:24:15.596382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 724/1438] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:15.601994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a6536a99-d0ad-4663-88e1-e4feb4e527df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045539 Sep 01 07:24:15.602556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 715/1439] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:15.783547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:15.785910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:15.792731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:15.793346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:15.794093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:15.794366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:15.794814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:15.795243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:15.826187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5db37639-bce4-4ca4-8f55-a182618cd659 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Sep 01 07:24:15.826744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 725/1440] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:16.607878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:16.610228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:16.613800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:16.615913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:16.616690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:16.617208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:16.617646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:16.618343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:16.618795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:16.619215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:16.621937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:16.622412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:16.622846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:16.623529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:16.623974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:16.624394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:16.648584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b5a4c0c-72f0-4f78-8fd6-fa8de9352cf1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044706 Sep 01 07:24:16.649344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 716/1441] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:16.653388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-360eff40-6682-4f89-91ce-26227e5ab450 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Sep 01 07:24:16.653942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 726/1442] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:16.839474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:16.841607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:16.848018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:16.848500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:16.848934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:16.849662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:16.850230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:16.851179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:16.875007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:16.880075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9d8edf7-d545-4951-95d8-39fa3f608b07 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045327 Sep 01 07:24:16.880619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 717/1443] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:17.660719 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:17.663539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:17.665587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:17.667739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:17.669944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:17.670416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:17.670843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:17.671521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:17.671957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:17.672369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:17.673965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:17.674457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:17.674900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:17.675593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:17.676052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:17.676481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:17.703647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47eb5875-4b3a-4459-88b7-5b2a64469bba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046830 Sep 01 07:24:17.704391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 727/1444] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:17.713594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5385f232-9c8b-4fc5-924e-6cc3c48cb94a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052250 Sep 01 07:24:17.714150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 718/1445] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:17.892408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:17.894560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:17.900385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:17.900840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:17.901304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:17.901974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:17.902411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:17.902824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:17.932205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12a5cbbd-6b0b-4849-8108-2da86c7a975f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Sep 01 07:24:17.932736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 728/1446] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:18.716599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:18.718814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:18.724795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:18.725300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:18.725776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:18.726208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:18.726891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:18.727297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:18.727408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:18.727739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:18.733539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:18.734017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:18.734448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:18.735128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:18.735575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:18.735993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:18.757630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6f5d122-6601-4da9-8a7e-250eb62c321a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044874 Sep 01 07:24:18.758583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 719/1447] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:18.774387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a454a573-fcc9-4727-870f-075f3180ddf7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053391 Sep 01 07:24:18.774956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 729/1448] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:18.944473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:18.946594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:18.952433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:18.952917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:18.953397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:18.954087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:18.954538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:18.954964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:18.983210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ed64799-b4dd-4584-85db-4d6e01c18b35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Sep 01 07:24:18.983754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 720/1449] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:19.770140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:19.772350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:19.778892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:19.779370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:19.779827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:19.780518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:19.780973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:19.781432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:19.786532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:19.788821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:19.795145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:19.795628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:19.796061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:19.796752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:19.797230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:19.797657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:19.811546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-90ca35fa-0ecf-4bd4-8b4f-c2e595f72f67 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045597 Sep 01 07:24:19.812104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 730/1450] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:19.827269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67cde605-edbb-48fb-9c0e-a5af2feda9ff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Sep 01 07:24:19.828188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 721/1451] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:19.996452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:19.998611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:20.004571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:20.005044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:20.005506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:20.006188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:20.006629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:20.007050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:20.043752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9651188c-5b79-457e-8378-72800b9f855a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051309 Sep 01 07:24:20.044549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 731/1452] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:20.823725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:20.825900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:20.832164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:20.832652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:20.833094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:20.833819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:20.834276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:20.834736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:20.839784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:20.841999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:20.848119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:20.848590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:20.849018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:20.849722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:20.850699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:20.851116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:20.864370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30be220b-44b0-4a85-9791-84d411271f99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044573 Sep 01 07:24:20.864934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 722/1453] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:20.879878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97c6b389-d123-4fb2-af6a-ed97a8130e79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Sep 01 07:24:20.880409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 732/1454] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:21.056478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:21.058673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:21.064657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:21.065302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:21.065651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:21.066349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:21.066810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:21.067342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:21.097763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e5711262-9b2c-47fe-b326-7902ef458497 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045884 Sep 01 07:24:21.098314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 723/1455] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:21.877074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:21.879217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:21.885798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:21.886280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:21.886713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:21.887392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:21.887837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:21.888255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:21.892922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:21.895073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:21.901875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:21.902355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:21.902790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:21.903482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:21.903929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:21.904350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:21.919028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2da6c730-46dd-4f3b-9d0e-9f6dbc50202b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045845 Sep 01 07:24:21.919581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 733/1456] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:21.933204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-61a7cf74-dc41-4c85-87b8-d6882d3270d9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 Sep 01 07:24:21.933753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 724/1457] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:22.111408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:22.113490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:22.119471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:22.119949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:22.120385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:22.121069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:22.121546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:22.121969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:22.152010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d886329b-a630-4996-b3de-b80a04372380 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Sep 01 07:24:22.152565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 734/1458] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:22.931954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:22.934258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:22.940727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:22.941243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:22.941683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:22.942380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:22.942965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:22.943395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:22.945788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:22.948029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:22.954346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:22.954881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:22.955373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:22.956122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:22.956661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:22.957184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:22.972822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-38efe536-baaf-45f7-ad94-fa6eb8ea79b8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045436 Sep 01 07:24:22.973411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 725/1459] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:22.986491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e66e053c-89fe-46eb-a373-8c3af9d77d1e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Sep 01 07:24:22.987040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 735/1460] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:23.164643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:23.166852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:23.172729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:23.173169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:23.173614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:23.174320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:23.174770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:23.175192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:23.203876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f0e74600-c885-4f36-9761-f4eeaccdf808 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Sep 01 07:24:23.204411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 726/1461] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:23.985685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:23.987909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:23.995052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:23.995535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:23.996161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:23.999663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:24.001848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:24.002695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:24.003168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:24.003599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:24.008177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:24.008668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:24.009111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:24.009832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:24.010292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:24.010719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:24.033017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5fc7a35-a775-469f-a9b0-47f1d86dc1ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051196 Sep 01 07:24:24.033584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 736/1462] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:24.040066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a520f7c-f1a1-414b-a1e8-5f74f98833ba tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Sep 01 07:24:24.040619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 727/1463] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:24.216414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:24.218566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:24.224422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:24.224888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:24.225923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:24.226597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:24.227042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:24.227461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:24.255804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c359d4a-2c4c-4641-887a-8ba6798b95e0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043292 Sep 01 07:24:24.256341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 737/1464] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:25.045297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:25.047560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:25.051809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:25.054476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:25.054762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:25.054999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:25.055679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:25.056139 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:25.056643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:25.057071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:25.061476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:25.061952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:25.062465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:25.063146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:25.063582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:25.064115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:25.086631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ba128dd-ff94-4608-b2a8-b9acdf9fcc23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045320 Sep 01 07:24:25.087184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 728/1465] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 07:24:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:24:25.093410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4917d5e0-154a-4cf2-b35b-feef1cf394a5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Sep 01 07:24:25.093950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 738/1466] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:25.268192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:25.270364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:25.276180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:25.276663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:25.277097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:25.277806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:25.278258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:25.278685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:25.307874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7e28ed2-bd20-4be9-8233-d68ad41d17f5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Sep 01 07:24:25.308353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 729/1467] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:26.099091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:24:26.101836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:26.108148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:26.108627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:26.109050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:26.109764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:26.110274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:26.110933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:26.111064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:26.112916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:26.120792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:26.121524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:26.121958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:26.122812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:26.123269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:26.123696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:26.125805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:26.154249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07a2fda4-483a-444c-9554-ee8294fc1964 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052228 Sep 01 07:24:26.154834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 730/1468] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:26.245869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec22bfb5-5766-4c1c-abff-513b852d0f25 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "POST /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/action" status: 200 len: 37699 microversion: 2.20 time: 0.150463 Sep 01 07:24:26.246611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 739/1469] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Sep 1 07:24:26 2022] POST /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0/action => generated 37699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:24:26.320320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:26.322540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:26.328323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:26.328804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:26.329340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:26.330032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:26.330484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:26.330909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:26.359001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-510edfdf-02f5-49c7-a370-c0f132d65b65 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Sep 01 07:24:26.359536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 731/1470] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:27.167275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:27.169532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:27.179577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:27.180057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:27.180604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:27.181459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:27.181903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:27.182309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:27.213593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4dcfffce-8eb4-4422-9311-6b59998087aa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050864 Sep 01 07:24:27.214137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 740/1471] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:27.370888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:27.373041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:27.379370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:27.379849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:27.380280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:27.380962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:27.381508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:27.381908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:27.413741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b86fcfb4-2ac3-4cee-a056-8cf278decc75 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Sep 01 07:24:27.414214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 732/1472] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:28.226388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:28.228599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:28.235353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:28.235835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:28.236269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:28.236960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:28.237435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:28.237858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:28.267946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d3a1b13-baca-41d5-865a-5c3af2ae2818 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046180 Sep 01 07:24:28.268491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 741/1473] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:28.425833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:28.428137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:28.434938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:28.435425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:28.435862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:28.436560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:28.437010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:28.437464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:28.467217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5bd3c04-5cc9-4c2b-b77f-015102390379 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Sep 01 07:24:28.467572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 733/1474] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:29.280318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:29.282498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:29.288724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:29.289236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:29.289669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:29.290346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:29.290790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:29.291220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:29.321067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b69fae46-f2f9-4eee-82c3-6904375d017d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Sep 01 07:24:29.321648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 742/1475] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:29.479203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:29.481389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:29.487679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:29.488154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:29.488584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:29.489297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:29.489746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:29.490162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:29.504244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:29.520828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf6630e4-bd4e-4604-8a7d-faf44d43a7c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045610 Sep 01 07:24:29.521402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 734/1476] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:30.332877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:30.335560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:30.342000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:30.342486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:30.342907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:30.343587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:30.344031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:30.344460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:30.374721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0eca09b6-bc5e-46f7-a831-402998b20f47 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045607 Sep 01 07:24:30.375393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 743/1477] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:30.532847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:30.535003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:30.541187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:30.541661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:30.542087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:30.542764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:30.543211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:30.543628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:30.572528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dc333ce7-858a-464e-b3b8-46072bb9bfd1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 Sep 01 07:24:30.573061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 735/1478] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:31.387345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:31.389575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:31.401056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:31.406064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:31.406522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:31.407323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:31.407807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:31.408235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:31.437268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-839e0270-8164-42e8-b543-984c83f86cea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053769 Sep 01 07:24:31.437824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 744/1479] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:31.584062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:31.586310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:31.592616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:31.593101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:31.593571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:31.594272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:31.594729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:31.595155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:31.624213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3cbed305-77b6-4328-9c3d-9d54c1d31b94 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Sep 01 07:24:31.624694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 736/1480] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:32.450112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:32.452566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:32.459822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:32.460296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:32.460715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:32.461414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:32.461849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:32.462257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:32.491160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e2f3f89-ab84-4dab-b791-794b2d1996de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Sep 01 07:24:32.491709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 745/1481] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:32.635880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:32.638084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:32.644701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:32.645212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:32.645650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:32.646336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:32.647301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:32.647727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:32.676953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed6686a7-1fe2-428c-bb07-b298cf53705a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Sep 01 07:24:32.677496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 737/1482] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:33.503256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:33.505420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:33.511949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:33.512427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:33.512860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:33.513586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:33.514030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:33.514454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:33.543775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89029232-e57a-4066-b392-b898198d7a96 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Sep 01 07:24:33.544321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 746/1483] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:33.688829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:33.691028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:33.697389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:33.697877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:33.698316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:33.699004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:33.699454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:33.699879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:33.728729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd9985af-7b51-4121-8d31-3e3d3d257f73 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Sep 01 07:24:33.729300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 738/1484] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:34.556252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:34.558409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:34.564794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:34.565311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:34.565744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:34.566428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:34.566869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:34.567285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:34.596994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-530131c1-3d0e-4e5b-b411-5d3366fa8070 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Sep 01 07:24:34.597568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 747/1485] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:34.740956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:34.743187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:34.749487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:34.749969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:34.750401 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:34.751092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:34.751549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:34.751973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:34.783237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9222cdeb-aac6-4d09-b6d5-7fd8fdbebd7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047172 Sep 01 07:24:34.783799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 739/1486] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:35.609538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:35.611683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:35.618488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:35.618958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:35.619379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:35.620055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:35.620501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:35.620915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:35.650694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b380321-de16-43b8-9784-796075cf0f10 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Sep 01 07:24:35.651231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 748/1487] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:35.795168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:35.799226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:35.806405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:35.806924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:35.807384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:35.808073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:35.808529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:35.808949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:35.838515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3f7666d0-b3a7-43ab-b8e5-4202d172fabe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047179 Sep 01 07:24:35.839056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 740/1488] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:36.663264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:36.665408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:36.671619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:36.672088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:36.672515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:36.673699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:36.674225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:36.674858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:36.703844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9af4a8eb-8690-4a2c-936b-c353de9ab45c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Sep 01 07:24:36.704390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 749/1489] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:36.852663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:36.854917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:36.861362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:36.861851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:36.862306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:36.862988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:36.863446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:36.863874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:36.892558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f96ec238-6ae2-4b7d-9b68-87c2e75df9f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Sep 01 07:24:36.893110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 741/1490] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:37.715922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:37.718071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:37.724427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:37.725593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:37.726022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:37.726702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:37.727141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:37.727552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:37.755667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7b1c06f-73cd-4bb5-a5d7-bc7bad562aad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Sep 01 07:24:37.756464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 750/1491] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:37.905084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:37.907406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:37.909930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=78 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:37.915904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:37.916398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:37.916837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:37.917564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:37.918145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:37.918583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:37.948261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca90f654-ee06-486f-b695-5f5383c230c8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047185 Sep 01 07:24:37.948804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 742/1492] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:38.768094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:38.770464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:38.778628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:38.779290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:38.779724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:38.780420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:38.780906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:38.781362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:38.810055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4df7b71-1056-41df-a184-94772a42cc89 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Sep 01 07:24:38.810612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 751/1493] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:38.960887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:38.963103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:38.969455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:38.969951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:38.970392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:38.971091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:38.971547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:38.971973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:39.000473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffe2303d-55a5-4766-ad04-1d6168b2bb39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Sep 01 07:24:39.001019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 743/1494] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:39.822861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:39.824979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:39.831440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:39.831907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:39.832335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:39.833019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:39.833562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:39.833890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:39.862350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b830b200-3631-4781-a92e-1a2f4c9fa2dd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Sep 01 07:24:39.862897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 752/1495] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:40.012702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:40.014989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:40.021571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:40.021999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:40.022448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:40.023194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:40.023592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:40.024094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:40.053677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-500fcb60-569c-44e3-8c26-3c400c261b11 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Sep 01 07:24:40.054231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 744/1496] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:40.875161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:40.877393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:40.879867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=72 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:40.885129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:40.885613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:40.886052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:40.886939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:40.887190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:40.887613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:40.918583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ca91147-a343-4c7b-a649-ebb89436d579 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047353 Sep 01 07:24:40.919269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 753/1497] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:41.064964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:41.067105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:41.073649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:41.074121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:41.074547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:41.075238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:41.075684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:41.076100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:41.106128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d3028f4f-9f70-4f27-a630-fb7ef3f574d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Sep 01 07:24:41.106675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 745/1498] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:41.931240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:41.933388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:41.939698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:41.940161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:41.940587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:41.941285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:41.941723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:41.942134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:41.972343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4d1c5993-fc62-42ee-a58b-e8340b99b9e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Sep 01 07:24:41.973150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 754/1499] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:42.119934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:42.122552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:42.129855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:42.130345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:42.130788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:42.132167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:42.132624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:42.133051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:42.162344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db020f0f-1ba8-4b10-970c-feee10ee3bf3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048121 Sep 01 07:24:42.162890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 746/1500] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:42.984087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:42.986181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:42.992467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:42.992946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:42.993411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:42.994088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:42.994535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:42.994956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:43.024432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-584a7f5f-ae0c-43d8-95c8-8d802daae977 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Sep 01 07:24:43.024998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 755/1501] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:43.174153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:43.176283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:43.182447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:43.182922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:43.183358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:43.184041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:43.184488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:43.184911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:43.215216 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-13e3f274-6b99-4699-8d1a-db5920425ebd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Sep 01 07:24:43.215768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 747/1502] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:44.035864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:44.038025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:44.044458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:44.044935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:44.045408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:44.046090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:44.046539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:44.046961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:44.061420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:44.077675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4cb92bd8-45e4-414a-a96b-271d12ccb0b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Sep 01 07:24:44.078231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 756/1503] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:44.227444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:44.229724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:44.235994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:44.236482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:44.236925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:44.237649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:44.238109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:44.238538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:44.268062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a11f02a3-b8ec-435d-8356-c80e776ae5eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Sep 01 07:24:44.268610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 748/1504] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:45.089816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:45.092000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:45.098353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:45.098825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:45.099257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:45.099930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:45.100380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:45.100795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:45.130081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf4e5d58-a6f9-43a2-ba35-9dfcd674a0da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 Sep 01 07:24:45.130842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 757/1505] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:45.279773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:45.281961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:45.288206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:45.288686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:45.289135 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:45.289834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:45.290278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:45.290697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:45.321106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a33d8ca0-e5aa-4cac-aa5c-361a4b2cddee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Sep 01 07:24:45.321684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 749/1506] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:46.143155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:46.145345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:46.152184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:46.152660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:46.153092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:46.153809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:46.154253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:46.154670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:46.183954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11812a71-799c-4479-bbaf-d0146f8c8b5b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Sep 01 07:24:46.184510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 758/1507] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:46.333104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:46.335860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:46.342146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:46.342626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:46.343060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:46.343747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:46.344196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:46.344618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:46.373637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50196231-2b98-47be-89be-0005691a37e2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Sep 01 07:24:46.374187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 750/1508] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:47.196205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:47.198350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:47.204656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:47.205143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:47.205577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:47.206250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:47.206692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:47.207113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:47.235709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f243a273-c234-4af3-a448-8aea3d43cd7a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Sep 01 07:24:47.236262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 759/1509] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:47.385390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:47.387560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:47.393888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:47.394376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:47.394825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:47.395520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:47.395975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:47.396401 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:47.400519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:24:47.427972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3fe66203-398b-45de-b528-41c59e647c26 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Sep 01 07:24:47.428706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 751/1510] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:48.247919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:48.250088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:48.256341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:48.256808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:48.257267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:48.257943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:48.258367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:48.258776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:48.287633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8467637-f081-4ada-bbe7-0170308d3cf1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Sep 01 07:24:48.288930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 760/1511] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:48.439931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:48.442199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:48.449084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:48.449594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:48.450029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:48.450714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:48.451174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:48.451595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:48.482028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50771789-3dcf-4058-aa2d-66f8e8804f95 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 Sep 01 07:24:48.484678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 752/1512] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:49.300461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:49.302624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:49.309807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:49.310276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:49.310704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:49.311375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:49.311816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:49.312230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:49.340292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f9d220f-e72c-410c-9b7e-bb4b9d5215a8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Sep 01 07:24:49.340830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 761/1513] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:49.496402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:49.498586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:49.504871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:49.505394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:49.505839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:49.506573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:49.507071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:49.507501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:49.537474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-79e7e9da-addf-409d-a61a-f4d1278d47ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Sep 01 07:24:49.538019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 753/1514] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:50.352607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:50.354732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:50.361330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:50.361872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:50.362331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:50.363036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:50.363472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:50.363884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:50.393274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34d5ece0-f857-4bfd-bcd9-955f36c2526f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Sep 01 07:24:50.393819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 762/1515] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:50.549568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:50.551726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:50.558100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:50.558581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:50.559015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:50.559700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:50.560145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:50.560570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:50.589756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-91531329-644f-4909-b396-888415141f5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044049 Sep 01 07:24:50.590300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 754/1516] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:51.405405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:51.407597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:51.414782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:51.415254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:51.415685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:51.416361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:51.416806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:51.417273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:51.445790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1c02bb0a-953e-487c-91f4-3e247a3bc4df tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044345 Sep 01 07:24:51.446332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 763/1517] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:51.604259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:51.607594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:51.614785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:51.615263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:51.615698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:51.616385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:51.616830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:51.617276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:51.647112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87c6d36f-604c-45aa-a7a4-5b8f644cef99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049632 Sep 01 07:24:51.648425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 755/1518] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:52.458135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:52.460255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:52.466655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:52.467130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:52.467560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:52.468238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:52.468679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:52.469095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:52.498101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7d7cb25-516f-4e81-85b9-416c1d77de36 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Sep 01 07:24:52.498638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 764/1519] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:52.659302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:52.661458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:52.668092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:52.668577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:52.669015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:52.669740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:52.670192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:52.670615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:52.699940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a92577bd-c162-4d93-a004-f56750c8c8fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Sep 01 07:24:52.700672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 756/1520] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:53.510905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:53.513050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:53.519592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:53.520055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:53.520482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:53.521201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:53.521637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:53.522050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:53.550323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71e8147a-0627-4c6e-80f4-72a3e1fe1957 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044053 Sep 01 07:24:53.550871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 765/1521] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:53.711695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:53.713855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:53.720121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:53.720606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:53.721045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:53.721769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:53.722224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:53.722647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:53.757299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a890e6a5-5189-4183-ad4f-53344d8c02e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044879 Sep 01 07:24:53.757299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 757/1522] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:54.562959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:54.565167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:54.572093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:54.572567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:54.572999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:54.573701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:54.574147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:54.574563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:54.602928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b31e0df2-7621-46ad-b01d-5500fae9b23e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Sep 01 07:24:54.603466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 766/1523] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:54.765142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:54.767557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:54.774334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:54.774819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:54.775258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:54.775953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:54.776405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:54.776826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:54.807053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83651325-b4ab-455a-bb0e-3b82b2619403 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045995 Sep 01 07:24:54.807603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 758/1524] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:55.614185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:55.616799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:55.623069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:55.623535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:55.623961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:55.624626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:55.625063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:55.625501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:55.654102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e5163d8d-7022-4f84-954f-1b7e03a46025 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Sep 01 07:24:55.654631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 767/1525] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:55.818920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:55.821747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:55.827544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:55.828036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:55.828470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:55.829194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:55.829655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:55.830081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:55.864065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eb52043a-5dd8-4dbd-bdcf-1de0382613d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049191 Sep 01 07:24:55.864700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 759/1526] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:56.666720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:56.668868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:56.675127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:56.675597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:56.676034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:56.676681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:56.677140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:56.677548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:56.706098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-175dad9c-c165-4aa2-932b-6591beaa370a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Sep 01 07:24:56.706632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 768/1527] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:56.877067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:56.879196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:56.885573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:56.886055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:56.886493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:56.887183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:56.887636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:56.888140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:56.918470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-88bee269-32f5-4818-8839-9dedd1f819d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Sep 01 07:24:56.919038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 760/1528] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:57.718282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:57.720407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:57.727048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:57.727527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:57.727980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:57.728666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:57.729135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:57.729590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:57.758706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a1b6cc8-7681-4f95-ac7b-d2efecd6d6d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Sep 01 07:24:57.759272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 769/1529] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:24:57.931182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:57.933506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:57.939742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:57.940221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:57.940653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:57.941392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:57.941840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:57.942261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:57.972953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83c28103-efb7-4a3c-a170-8cd2e591c2a8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046216 Sep 01 07:24:57.973511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 761/1530] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:58.771153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:58.773860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:58.780310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:58.780787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:58.781237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:58.781915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:58.782361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:58.782774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:58.811273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0bbde283-2072-40b8-9549-207ee74661fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Sep 01 07:24:58.811836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 770/1531] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:58.985595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:58.987661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:58.994008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:58.994479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:58.994909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:58.995588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:58.996061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:58.996485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:59.027651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36ff6415-19ee-485b-9a33-28a76caf07ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046068 Sep 01 07:24:59.028209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 762/1532] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:24:59.823546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:24:59.825697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:24:59.832027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:59.832497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:59.832932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:59.833642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:24:59.834114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:24:59.834530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:24:59.862907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0edf9700-7034-4fec-90ec-d0aaaf3dc050 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Sep 01 07:24:59.863456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 771/1533] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:24:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:00.040432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:00.042603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:00.048880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:00.049397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:00.049837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:00.050531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:00.050990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:00.051417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:00.080762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2eca1a54-3dbe-4e3c-9448-3b2f62aa003a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Sep 01 07:25:00.081359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 763/1534] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:00.875819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:00.877968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:00.884930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:00.885432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:00.885859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:00.886540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:00.886984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:00.887398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:00.915682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca26cb34-12af-48c2-ad60-f171be01dfbd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Sep 01 07:25:00.916249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 772/1535] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:01.093450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:01.095613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:01.101904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:01.102392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:01.102825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:01.103513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:01.103964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:01.104387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:01.134117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b7d75d34-84b0-45a0-a8f2-b01b64a86419 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044561 Sep 01 07:25:01.134681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 764/1536] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:01.928063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:01.932511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:01.938560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:01.939030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:01.939455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:01.940127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:01.940567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:01.941040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:01.943295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:01.970687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7de6036-a3cb-41e1-b4fc-42f9f9cf8350 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046717 Sep 01 07:25:01.971234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 773/1537] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:02.146099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:02.148854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:02.155061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:02.155535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:02.155966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:02.156640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:02.157084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:02.157528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:02.185804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a1abb66d-e646-4aa9-b17a-8e4f4c5af53e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043580 Sep 01 07:25:02.186355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 765/1538] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:02.982532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:02.984596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:02.990896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:02.991394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:02.991827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:02.992505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:02.992947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:02.993390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:03.022189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d84ffbc7-63b8-420d-922b-bcdd536cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 Sep 01 07:25:03.023277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 774/1539] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:03.198368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:03.200468 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:03.206879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:03.207357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:03.207786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:03.208461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:03.208905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:03.209358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:03.237742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da18f8bc-5eab-4a79-b38a-45033847b665 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Sep 01 07:25:03.238336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 766/1540] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:04.034865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:04.037007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:04.043907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:04.044389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:04.044822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:04.045539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:04.045980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:04.046397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:04.074263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0b8df48-75f9-4702-b3c3-06b7d241025f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Sep 01 07:25:04.074799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 775/1541] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:04 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:04.250365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:04.252481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:04.259285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:04.259756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:04.260184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:04.260860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:04.261347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:04.261769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:04.286451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:04.291474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-489669c9-5ed8-4461-b0bd-aa30af9a79cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Sep 01 07:25:04.292031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 767/1542] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:05.087074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:05.089237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:05.095561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:05.096034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:05.096469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:05.097209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:05.097659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:05.098080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:05.126271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55b7e049-1f15-4a5a-92f9-a06ff6135771 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Sep 01 07:25:05.126811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 776/1543] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:05.303882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:05.306048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:05.312431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:05.312916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:05.313389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:05.314079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:05.314534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:05.314960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:05.343975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-62cdac34-0ccc-4981-8fd0-2fda678ed38c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 Sep 01 07:25:05.344560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 768/1544] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:06.138514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:06.140936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:06.147988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:06.148459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:06.148885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:06.149591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:06.150034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:06.150451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:06.180336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb310e9f-048b-41d0-a3dd-1cf0607a603a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045856 Sep 01 07:25:06.180897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 777/1545] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:06.356430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:06.358614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:06.364926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:06.365488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:06.365925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:06.366613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:06.367063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:06.367491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:06.396057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-00df0c7c-af1f-4585-8f40-2df9a3e1f988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 Sep 01 07:25:06.396546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 769/1546] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:07.192580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:07.195262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:07.201611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:07.202091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:07.202522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:07.203201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:07.203647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:07.204065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:07.232550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e69bf65b-642a-4759-8095-383c84e8b4d2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Sep 01 07:25:07.233084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 778/1547] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:07.407748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:07.409901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:07.416119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:07.416594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:07.417025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:07.417730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:07.418182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:07.418609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:07.447251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2db4cb6-9ddb-4ec4-ae9d-0844540b1525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043316 Sep 01 07:25:07.447728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 770/1548] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:08.244849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:08.247013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:08.253374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:08.253853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:08.254284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:08.254963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:08.255408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:08.255826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:08.288287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5fb7553-51ea-4530-a2b7-298af55abe8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047269 Sep 01 07:25:08.288847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 779/1549] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:08.459219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:08.461975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:08.464260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=58 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:08.469412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:08.469894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:08.470333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:08.471021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:08.471472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:08.471895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:08.502653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-33c3c397-a674-4058-a686-85dc2e0a2988 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047298 Sep 01 07:25:08.503145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 771/1550] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:09.300089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:09.302238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:09.309209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:09.309682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:09.310109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:09.310785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:09.311228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:09.311645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:09.340111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a23a5e80-5f41-451e-8e6f-5c3cad3db38d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Sep 01 07:25:09.340652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 780/1551] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:09.514580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:09.517008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:09.523396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:09.523877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:09.524315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:09.525004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:09.525491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:09.525915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:09.555340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f7a1413-738d-4372-b0f6-ef518553c768 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Sep 01 07:25:09.555817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 772/1552] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:10.351889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:10.354056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:10.360386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:10.360851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:10.361317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:10.361980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:10.362420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:10.362831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:10.392241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3942149f-f37c-4ded-81d9-f963ee9214ec tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Sep 01 07:25:10.392788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 781/1553] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:10.567174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:10.569971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:10.576209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:10.576722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:10.577191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:10.577885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:10.578342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:10.578767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:10.607049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d75a1b05-f1ea-4b50-9d70-8346f5add455 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043721 Sep 01 07:25:10.607529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 773/1554] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:11.403886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:11.406099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:11.408391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=58 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:11.414399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:11.414925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:11.415351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:11.416028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:11.416467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:11.416906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:11.446121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-481c3948-834c-4aa9-8157-8123b2b04e1f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Sep 01 07:25:11.446689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 782/1555] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:11.619474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:11.621572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:11.627829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:11.628311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:11.628747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:11.629467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:11.629920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:11.630346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:11.659548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-29033771-0521-4f74-92ab-db81b5af049a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Sep 01 07:25:11.660090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 774/1556] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:12.458479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:12.461227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:12.467785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:12.468253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:12.468679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:12.469379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:12.469823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:12.470240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:12.500466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b557ac3-dbf1-4f19-94e4-f1d9784a1d3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045979 Sep 01 07:25:12.501187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 783/1557] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:12.672030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:12.674307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:12.680633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:12.681206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:12.681650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:12.682347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:12.682797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:12.683219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:12.713662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19ae650d-c95c-46e8-81cb-c6992880cc7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045453 Sep 01 07:25:12.714146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 775/1558] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:13.516160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:13.518407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:13.525214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:13.525690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:13.526117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:13.526792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:13.527238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:13.527655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:13.556549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c2ef565-8510-428a-8665-2236f0895e33 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Sep 01 07:25:13.557178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 784/1559] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:13.727755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:13.729937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:13.736286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:13.736762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:13.737220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:13.737911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:13.738363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:13.738786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:13.768280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-874a9d62-1bc8-44d1-bfd2-acf836862ffe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Sep 01 07:25:13.768878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 776/1560] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:14.568706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:14.571545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:14.577932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:14.578405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:14.578837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:14.579513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:14.579957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:14.580403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:14.608825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9240793d-8414-4d20-9239-76e85301b076 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044088 Sep 01 07:25:14.609412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 785/1561] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:14.781989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:14.784184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:14.791011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:14.791493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:14.791935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:14.792622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:14.793080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:14.793536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:14.822561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-41bc723b-1d18-4edc-89a8-51c901a41864 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Sep 01 07:25:14.823106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 777/1562] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:15.621613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:15.623749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:15.629972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:15.630439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:15.630866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:15.631563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:15.632001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:15.632415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:15.660397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d42ef08-9540-431b-aa2e-1f5e4cdb762d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Sep 01 07:25:15.660926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 786/1563] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:15.835019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:15.837223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:15.843480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:15.843965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:15.844402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:15.845091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:15.845570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:15.845997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:15.874769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eaf78903-8ffe-4ef2-94ba-df5b6a80140d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Sep 01 07:25:15.875250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 778/1564] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:16.673039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:16.675169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:16.681978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:16.682449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:16.682882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:16.683553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:16.683986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:16.684397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:16.713012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f913fef-9b94-4fc9-94ce-8e610630d4ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Sep 01 07:25:16.713591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 787/1565] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:16.887278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:16.889529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:16.896124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:16.896606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:16.897048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:16.897759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:16.898215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:16.898642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:16.927290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3802122-d0f2-46e4-9068-cdd64de7bd80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Sep 01 07:25:16.927766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 779/1566] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:17.725179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:17.727292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:17.733534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:17.734006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:17.734433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:17.735110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:17.735551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:17.735967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:17.764568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a15db499-ec39-40c2-a75e-514806f5a2b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Sep 01 07:25:17.765526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 788/1567] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:17.939659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:17.941813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:17.948712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:17.949224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:17.949657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:17.950343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:17.950790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:17.951211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:17.980052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af148018-f4c7-496b-a58e-bace65f7a03d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Sep 01 07:25:17.980590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 780/1568] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:18.777901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:18.780071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:18.786499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:18.786909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:18.787341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:18.788613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:18.789065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:18.789510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:18.814484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:18.819477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-673426bf-43c1-456a-80ea-6a70bda5b447 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Sep 01 07:25:18.820035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 789/1569] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:18.992510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:18.995727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:19.003718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:19.004208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:19.004649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:19.005906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:19.006991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:19.007422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:19.036113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a1db289-75fd-41a6-89bd-7f455f75b214 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 Sep 01 07:25:19.036667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 781/1570] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:19.832173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:19.834830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:19.841053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:19.841551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:19.841972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:19.842643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:19.843080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:19.843493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:19.871884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e379a96c-d8fe-4ae2-85f1-c0bef20ec048 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Sep 01 07:25:19.872414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 790/1571] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:20.047822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:20.050035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:20.056321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:20.056797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:20.057272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:20.057950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:20.058396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:20.058813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:20.087928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-69fb4860-3ece-430a-a055-e53970d4fad9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Sep 01 07:25:20.088482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 782/1572] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:20.884105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:20.886286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:20.892931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:20.893464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:20.893898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:20.894573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:20.895015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:20.895432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:20.923812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67a94863-2a39-4ec1-9dd1-083d67b56fd2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Sep 01 07:25:20.924346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 791/1573] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:21.099731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:21.102593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:21.108857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:21.109368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:21.109807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:21.110491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:21.110944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:21.111369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:21.145848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-199ea70e-34e4-48cc-a182-cc252ceba103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049369 Sep 01 07:25:21.146556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 783/1574] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:21.936053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:21.938208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:21.945130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:21.945618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:21.946046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:21.946727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:21.947169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:21.947587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:21.977187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-052bfec9-178c-47e6-aa3e-387669cd360a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Sep 01 07:25:21.977755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 792/1575] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:22.159899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:22.162042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:22.168494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:22.168994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:22.169460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:22.170146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:22.170593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:22.171009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:22.184864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:22.202612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2cedf2f4-d849-40a0-8afc-de2c9551041d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Sep 01 07:25:22.203176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 784/1576] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:22.988959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:22.991865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:22.998485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:22.999215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:22.999716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:23.000455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:23.000894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:23.001365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:23.030618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9f71936-3a4e-48b3-93ea-c45e2a4e38c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045446 Sep 01 07:25:23.031150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 793/1577] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:23.216033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:23.218308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:23.224125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:23.224604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:23.225571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:23.226261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:23.226707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:23.227123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:23.261473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c142e765-de2d-4eb3-970d-f0f28669c178 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050523 Sep 01 07:25:23.262059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 785/1578] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:24.042909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:24.045085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:24.051502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:24.051972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:24.052396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:24.053682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:24.054119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:24.054532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:24.083142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d279bae0-9685-4164-a6c9-6d14a73a9b87 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Sep 01 07:25:24.083693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 794/1579] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:24 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:24.275501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:24.278364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:24.285386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:24.285879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:24.286326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:24.287036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:24.287524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:24.287961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:24.317399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a42c359-0dad-4da1-b7e8-c61b19551634 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047151 Sep 01 07:25:24.317912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 786/1580] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:25.095253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:25.097454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:25.104442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:25.104923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:25.105392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:25.106071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:25.106522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:25.106941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:25.135451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c6c7186-861a-43c2-88d6-9130d99d1f9b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044170 Sep 01 07:25:25.135988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 795/1581] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:25:25.329351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:25.331516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:25.338425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:25.338930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:25.339363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:25.340047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:25.340496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:25.340918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:25.370635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34a8893b-6e3c-4bd9-b3cd-e5f8f5623907 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Sep 01 07:25:25.371127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 787/1582] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:26.147663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:26.149811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:26.156037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:26.156506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:26.156929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:26.157626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:26.158063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:26.158473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:26.187646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d06d6001-a36d-47a1-9b5c-e670cea4ba61 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Sep 01 07:25:26.188187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 796/1583] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:26.384233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:26.386416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:26.392525 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:26.393004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:26.393579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:26.394298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:26.394754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:26.395179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:26.425565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4b260737-c2bf-4abc-ad77-5b4f3eef249f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Sep 01 07:25:26.426366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 788/1584] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:27.200555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:27.203104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:27.211331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:27.211818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:27.212258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:27.213458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:27.214255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:27.215029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:27.245648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0298f807-2f1d-43af-a172-5920b0e02002 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048990 Sep 01 07:25:27.246213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 797/1585] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:27.441907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:27.444866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:27.453643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:27.454249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:27.454856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:27.455842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:27.456482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:27.457077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:27.497261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-40818019-0fac-4fd7-a104-f960dbaed134 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062142 Sep 01 07:25:27.498011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 789/1586] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:28.258265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:28.260428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:28.267107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:28.267580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:28.268013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:28.268694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:28.269163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:28.269586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:28.301424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc02d1bc-5d9b-4ca6-9a0c-962966f039da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047550 Sep 01 07:25:28.301983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 798/1587] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:28.511779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:28.513896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:28.520410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:28.520892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:28.521372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:28.522699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:28.523155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:28.523583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:28.552416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b68d294-4b4f-489f-8815-56b3f86247f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Sep 01 07:25:28.553487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 790/1588] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:29.314210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:29.316665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:29.323156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:29.323635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:29.324071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:29.324750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:29.325229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:29.325650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:29.355634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-87d8c552-6430-438f-b4b0-06256b76fb99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Sep 01 07:25:29.356198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 799/1589] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:29.565255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:29.567343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:29.573647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:29.574137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:29.574549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:29.575256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:29.575701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:29.576118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:29.605456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65bbd898-0c4a-4eff-a461-499d5a8d179c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044213 Sep 01 07:25:29.606001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 791/1590] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:30.368123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:30.370512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:30.376915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:30.377423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:30.377944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:30.378572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:30.379127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:30.379605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:30.409482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48107c34-a9cc-4d62-b968-31ab205ce96c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045914 Sep 01 07:25:30.410050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 800/1591] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:30.617607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:30.619750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:30.626075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:30.626552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:30.626987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:30.627667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:30.628116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:30.628539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:30.659411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-24c978a3-deef-4a78-aa22-cdeabfcfdbe0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Sep 01 07:25:30.659954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 792/1592] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:31.421468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:31.423600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:31.430747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:31.431217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:31.431644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:31.432328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:31.432773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:31.433224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:31.461781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03c1b156-29ec-4684-890c-08ca4b02157e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044353 Sep 01 07:25:31.462332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 801/1593] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:31.671526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:31.673708 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:31.679989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:31.680474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:31.680917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:31.681651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:31.682111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:31.682539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:31.711330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b05a0017-81bd-47c8-a6dc-08c0eecace30 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Sep 01 07:25:31.711868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 793/1594] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:32.473406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:32.475563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:32.482310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:32.482860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:32.483287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:32.483970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:32.484415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:32.484834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:32.513895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8dd28864-b627-4e5e-a072-4b4cccdd2667 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Sep 01 07:25:32.514432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 802/1595] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:32.723226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:32.725978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:32.732212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:32.732691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:32.733142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:32.733853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:32.734304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:32.734729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:32.764123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3f6f355a-10e8-4423-bb86-fc8e04f47581 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Sep 01 07:25:32.764677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 794/1596] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:33.526797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:33.528940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:33.535465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:33.535938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:33.536371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:33.537056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:33.537528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:33.537977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:33.566382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3fb07de-8558-46fa-a2b4-999356504c73 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Sep 01 07:25:33.566924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 803/1597] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:33.776458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:33.778944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:33.785309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:33.785792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:33.786228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:33.786921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:33.787370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:33.787799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:33.818042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95c4b44a-d44b-4c86-bef0-f02843c1e66d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045500 Sep 01 07:25:33.819219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 795/1598] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:34.579342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:34.581476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:34.588596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:34.589067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:34.589523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:34.590213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:34.590656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:34.591073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:34.619853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9891e53-47a6-40fa-b226-a67ecc074194 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Sep 01 07:25:34.620395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 804/1599] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:34.830812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:34.832889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:34.839741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:34.840225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:34.840667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:34.841396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:34.841850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:34.842272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:34.871527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6bf71b61-51aa-43fa-91d7-c9c10887c9cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Sep 01 07:25:34.872069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 796/1600] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:35.632574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:25:35.634795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:35.641519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:35.642150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:35.642590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:35.643458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:35.643911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:35.644391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:35.763274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5a72efd-9da9-4829-9d19-9ea1281ffb71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/action" status: 200 len: 82451 microversion: 2.1 time: 0.134970 Sep 01 07:25:35.767337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 805/1601] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:25:35 2022] POST /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/action => generated 82451 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:25:35.777767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:35.778257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:35.784105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:35.784578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:35.785008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:35.785721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:35.786171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:35.786590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:35.883120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:35.885338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:35.892443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:35.892919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:35.893381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:35.894069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:35.894516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:35.894938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:35.922075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lazy-loading 'services' on Instance uuid e1ac467b-0a5f-4e70-952c-3bead582e098 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:25:35.924254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:35.931525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a439c1eb-fdf6-41a2-91c5-0a7a05974ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052816 Sep 01 07:25:35.932286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 806/1602] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:25:35.992707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aefc6579-de65-4329-b833-6b2424235ee8) Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Request method failure captured: Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments/18802add-a9b8-4a4b-be55-a832bf196f14 HTTP/1.1 Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFwryO5p4zS33zqUJNZTQWVmGUmHEeCr0nAlBGs9r7MlrlfqgIG8pRRUuLSoC6T5rs04hHUHjbI6Fo8VTe73423RswZvQuqQeN2M5rdYTMZrTnSu09mwgNoIwSpL5GNSJfcCLYQBXG-UPAOjUxKwaNrvTXwTEzz9QYD432mXzNWnGGY Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 670ca9b5239a4c5f9aa30faca7a4e519 Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestMinimumBasicScenario-706400232 Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:25:35.995031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/670ca9b5239a4c5f9aa30faca7a4e519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/670ca9b5239a4c5f9aa30faca7a4e519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/670ca9b5239a4c5f9aa30faca7a4e519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_670ca9b5239a4c5f9aa30faca7a4e519", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestMinimumBasicScenario-706400232 Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 670ca9b5239a4c5f9aa30faca7a4e519 Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-706400232 Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-TestMinimumBasicScenario-706400232-project Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 8a537ff040dc4559b103696638cdd9d5 Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestMinimumBasicScenario-706400232-project Sep 01 07:25:35.996702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aefc6579-de65-4329-b833-6b2424235ee8) Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'server_id': 'e1ac467b-0a5f-4e70-952c-3bead582e098', 'id': '18802add-a9b8-4a4b-be55-a832bf196f14'} Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 07:25:35.997770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aefc6579-de65-4329-b833-6b2424235ee8) Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 07:25:35.998930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aefc6579-de65-4329-b833-6b2424235ee8) Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:25:36.000359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aefc6579-de65-4329-b833-6b2424235ee8) Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:25:36.003060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aefc6579-de65-4329-b833-6b2424235ee8) Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aefc6579-de65-4329-b833-6b2424235ee8) Sep 01 07:25:36.005540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:25:36.007448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aefc6579-de65-4329-b833-6b2424235ee8) {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:25:36.007448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-16eb24f1-5a2d-4065-b4a1-ec6ac5d0d381 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments/18802add-a9b8-4a4b-be55-a832bf196f14" status: 400 len: 269 microversion: 2.1 time: 0.222725 Sep 01 07:25:36.007448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 797/1603] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:25:35 2022] DELETE /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098/os-volume_attachments/18802add-a9b8-4a4b-be55-a832bf196f14 => generated 269 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:25:36.944593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:36.946732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:36.953035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:36.953661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:36.954087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:36.954754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:36.955192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:36.955655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:36.984679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88929ed8-0184-484b-8b2d-a6c64dda1e7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Sep 01 07:25:36.985271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 807/1604] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:37.996427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:37.998567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:38.005064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:38.006150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:38.006584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:38.007259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:38.007706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:38.008125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:38.037760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-920ce802-946d-49e7-a48a-c7c3c926ee29 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045775 Sep 01 07:25:38.038319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 798/1605] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:39.050093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:39.052237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:39.058656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:39.059134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:39.059565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:39.060245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:39.060690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:39.061111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:39.090231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-083b336d-eb7d-4a7c-a85e-634e79b25657 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Sep 01 07:25:39.090778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 808/1606] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:40.102380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:40.104535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:40.106858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=56 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:40.112229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:40.112711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:40.113171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:40.113864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:40.114316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:40.115248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:40.144988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67943cd2-1241-4e7f-a443-d7bcad0cffcc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046137 Sep 01 07:25:40.145127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 799/1607] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:41.156773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:41.158926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:41.165313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:41.165787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:41.166214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:41.166890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:41.167332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:41.167746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:41.196341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1de0e8dc-68a0-4a6b-ac39-af5afa2eb20d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Sep 01 07:25:41.196876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 809/1608] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:42.207782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:42.210455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:42.216884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:42.217397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:42.217843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:42.218532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:42.218985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:42.219414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:42.244246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:42.249565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7b1852b5-ceca-4bac-b1a6-04a80e223430 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Sep 01 07:25:42.250134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 800/1609] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:25:43.262123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:43.264248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:43.266811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=56 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:25:43.271964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:43.272437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:43.272867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:43.273580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:43.274024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:43.274442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:43.304186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ca12989-1f0c-4039-bd7c-30b0ba996558 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045941 Sep 01 07:25:43.304732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 810/1610] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:44.316128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:44.318954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:44.325221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:44.325705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:44.326138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:44.326820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:44.327270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:44.327691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:44.356949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df8ba0b2-1177-45c5-b2a0-54fb72322a64 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Sep 01 07:25:44.357533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 801/1611] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:45.369078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:45.371257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:45.378082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:45.378554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:45.379110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:45.379832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:45.380786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:45.381238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:45.410678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9021eed7-a298-45a9-b442-38f2c1b07ccd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Sep 01 07:25:45.411221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 811/1612] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:46.422382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:46.424507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:46.431499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:46.431979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:46.432412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:46.433099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:46.433565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:46.433983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:46.462690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d9fe267-36e2-4a4e-b757-f9a351388d6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Sep 01 07:25:46.463237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 802/1613] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:47.474829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:47.477022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:47.483426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:47.483901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:47.484337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:47.485018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:47.485537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:47.485965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:47.518316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5a13fae-c6cd-4773-985a-11ba51335603 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047378 Sep 01 07:25:47.518893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 812/1614] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:48.530425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:25:48.532540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:48.539443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:48.539920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:48.540350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:48.541029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:48.541508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:48.541929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:48.570538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e48e9449-4396-4a63-95a3-2a39378454dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 Sep 01 07:25:48.571063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 803/1615] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:25:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:25:49.582666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:25:49.584872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:25:49.591225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:49.591698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:49.592128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:49.592807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:25:49.593343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:25:49.593763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:25:49.713851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3035cbc2-3f5f-43b1-9a73-0318d115f23a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "POST /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/action" status: 200 len: 76540 microversion: 2.1 time: 0.134812 Sep 01 07:25:49.721165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 813/1616] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:25:49 2022] POST /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a/action => generated 76540 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:29:56.308892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc108816-5355-489c-b59a-639bb8bc4023] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 07:29:56.309614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:29:56.309756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 (ip 10.222.0.46) !!! Sep 01 07:29:56.310707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:29:56.310840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 (ip 10.222.0.46) !!! Sep 01 07:29:56.311608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=9 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:29:56.312692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=19 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:29:56.313490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:29:56.313632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 (ip 10.222.0.46) !!! Sep 01 07:29:56.319710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:29:56.320214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:29:56.330734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:29:56.331223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:29:56.331658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:29:56.332354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:29:56.332805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:29:56.333271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:29:56.372646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:29:56.449015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-772a3ad0-978d-432e-8071-9d83de692496 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 204 len: 0 microversion: 2.1 time: 0.141814 Sep 01 07:29:56.452961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 804/1617] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:29:56 2022] DELETE /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:29:56.456832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11375ac0-d7e8-4c00-a589-a2d2741b56e8] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 07:29:56.460041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:29:56.460041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 (ip 10.222.0.46) !!! Sep 01 07:29:56.460041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=7 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:29:56.460385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=41 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:29:56.461690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 07:29:56.461821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 (ip 10.222.0.46) !!! Sep 01 07:29:56.462796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:29:56.462915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 (ip 10.222.0.46) !!! Sep 01 07:29:56.467481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:29:56.468169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:29:56.479432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:29:56.479909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:29:56.480345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:29:56.481023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:29:56.481495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:29:56.481911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:29:56.783362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:29:56.791871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-807a1870-aeb6-4c21-8061-94533f5e3ab6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.337267 Sep 01 07:29:56.792551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 814/1618] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:29:56 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:29:57.814225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:29:57.814950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:29:57.825534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:29:57.826015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:29:57.826478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:29:57.827166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:29:57.827615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:29:57.828040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:29:57.833596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc108816-5355-489c-b59a-639bb8bc4023] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 57776. Sep 01 07:29:57.955738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:29:57.963847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93152cb7-1d4a-487b-84bf-9bc36ae138e3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.153904 Sep 01 07:29:57.964416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 805/1619] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:29:57 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:29:58.985229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:29:58.985832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:29:58.993871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:29:58.994345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:29:58.994770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:29:58.995452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:29:58.995889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:29:58.996302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:29:59.012973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] [11375ac0-d7e8-4c00-a589-a2d2741b56e8] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 57786. Sep 01 07:29:59.126606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:29:59.135182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e6131db-aaf8-40cc-9cd9-7c4e2ad9ea6f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.153903 Sep 01 07:29:59.135729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 815/1620] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:29:58 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:00.156109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:00.156733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:00.163713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:00.164194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:00.164633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:00.165351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:00.165803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:00.166227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:00.295567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:00.303778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e6692cf-f2a1-4ee0-b9a4-3b1b6d3bd049 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151536 Sep 01 07:30:00.304448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 806/1621] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:00 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:01.325192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:01.325787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:01.332149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:01.332647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:01.333069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:01.334435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:01.334874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:01.335287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:01.463011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:01.471179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b2ddcae-4c15-4779-a2a4-d19506c5ae26 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149826 Sep 01 07:30:01.471735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 816/1622] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:01 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:02.492540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:02.493178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:02.499578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:02.500063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:02.500501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:02.501218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:02.501679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:02.502106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:02.628716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:02.637204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0cef1f3f-0213-40ca-be68-58273c89590b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149252 Sep 01 07:30:02.637767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 807/1623] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:02 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:03.658517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:03.659145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:03.666040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:03.666529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:03.666938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:03.667626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:03.668064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:03.668475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:03.797720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:03.805686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-709ec1f8-70c7-458e-ad19-64e473ee09bd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151044 Sep 01 07:30:03.806242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 817/1624] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:03 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:04.826629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:04.827243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:04.833671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:04.834150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:04.834584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:04.835272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:04.835723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:04.836145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:04.962524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:04.970893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2b38c46-419b-4f93-bcff-802ba68af31f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148443 Sep 01 07:30:04.971546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 808/1625] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:04 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:05.992235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:05.992822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:05.999079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:05.999552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:05.999984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:06.000666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:06.001106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:06.001548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:06.125372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:06.133930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-697261de-0c07-4bcf-9ac1-76745f7d6edb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146147 Sep 01 07:30:06.134474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 818/1626] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:05 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:07.154582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:07.155221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:07.161690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:07.162176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:07.163130 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:07.163826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:07.164283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:07.164710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:07.291572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:07.299619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-82e6d865-d8dd-4004-aac2-6704ccf2ffa9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148878 Sep 01 07:30:07.300186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 809/1627] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:07 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:08.321881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:08.322481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:08.328935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:08.329453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:08.329887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:08.330560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:08.330997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:08.331408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:08.463399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:08.471532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f317864-916f-4463-bb8e-0b5491727718 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.154170 Sep 01 07:30:08.472092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 819/1628] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:08 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:09.492987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:09.493558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:09.499996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:09.500484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:09.500924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:09.501662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:09.502140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:09.502567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:09.634113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:09.642669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d73759a-59f5-4187-9337-38237e3d2d20 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.153621 Sep 01 07:30:09.643233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 810/1629] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:09 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:10.663823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:10.664353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:10.670664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:10.671139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:10.671570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:10.672249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:10.672691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:10.673105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:10.799212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:10.807322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a619b3c-7db3-49b0-b80d-220e404c4b16 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147943 Sep 01 07:30:10.807874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 820/1630] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:10 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:11.828445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:11.829072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:11.835930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:11.836416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:11.836859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:11.837578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:11.838031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:11.838456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:11.962598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:11.970792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe49dc91-93b0-438f-82e8-c79c18550379 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146273 Sep 01 07:30:11.971352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 811/1631] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:11 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:12.992872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:12.993501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:13.000650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:13.001136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:13.001574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:13.002316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:13.002757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:13.003191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:13.132713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:13.141265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd8a9786-2356-4890-87b0-d65bcf06d0f6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152547 Sep 01 07:30:13.141926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 821/1632] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:12 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:14.164193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:14.165864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:14.172720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:14.173486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:14.174001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:14.174702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:14.175281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:14.175718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:14.318935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:14.327376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbb062eb-7401-4944-b2e9-bd0e182c2b43 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.168287 Sep 01 07:30:14.328138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 812/1633] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:14 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:15.348510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:15.349110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:15.355462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:15.355936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:15.356360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:15.357035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:15.357503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:15.357921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:15.490191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:15.499046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9659814-e236-4dba-b650-9def34d953ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.154256 Sep 01 07:30:15.499632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 822/1634] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:15 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:16.524794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:16.525622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:16.532728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:16.533168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:16.533619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:16.534325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:16.534782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:16.535420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:16.664802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:16.672977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-464f87f2-af26-41e3-ad2f-e5d156939902 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.154777 Sep 01 07:30:16.673635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 813/1635] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:16 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:17.693648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:17.694254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:17.700624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:17.701100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:17.701569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:17.702251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:17.702698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:17.703119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:17.829528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:17.838082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-759e97fb-5462-48d1-82da-3369906a4d81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148298 Sep 01 07:30:17.838647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 823/1636] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:17 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:18.859633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:18.860239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:18.866682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:18.867165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:18.867598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:18.868278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:18.868722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:18.869160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:18.997723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:19.005804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e618f27f-e7c0-4d3b-986d-0e0be7967711 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150043 Sep 01 07:30:19.006396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 814/1637] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:18 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:20.026608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:20.027222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:20.033677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:20.034156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:20.034591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:20.035279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:20.035725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:20.036148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:20.161612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:20.170313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d01247d5-5376-4e5e-a3e7-e147e1f9c973 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147572 Sep 01 07:30:20.170870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 824/1638] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:20 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:21.191554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:21.192157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:21.199050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:21.199524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:21.199953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:21.200632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:21.201088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:21.201532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:21.332427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:21.340602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-347e20a4-c3e1-4f61-aba4-35c500dc41f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152899 Sep 01 07:30:21.341192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 815/1639] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:21 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:22.361215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:22.362054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:22.369281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:22.369760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:22.370190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:22.370870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:22.371312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:22.371732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:22.499195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:22.507307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e92c7f64-a83d-4dd1-97a2-d2dc767a0640 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149997 Sep 01 07:30:22.507867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 825/1640] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:22 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:23.528744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:23.529422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:23.535798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:23.536279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:23.536718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:23.537455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:23.537907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:23.538338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:23.667877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:23.676395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dc5edac2-a4b1-4a6f-869f-bc76d39ec359 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151475 Sep 01 07:30:23.676963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 816/1641] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:23 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:24.697665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:24.698268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:24.704772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:24.705276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:24.705701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:24.706372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:24.706814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:24.707225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:24.833391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:24.841890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-22b779cd-661f-4be1-acc7-f14a9b45f755 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148100 Sep 01 07:30:24.842439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 826/1642] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:24 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:25.863913 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:25.864556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:25.870938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:25.871417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:25.871848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:25.872533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:25.872984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:25.873443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:26.003330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:26.011892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb9ffafd-f888-4df7-a788-f85ee333b288 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151809 Sep 01 07:30:26.012456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 817/1643] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:25 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:26.902803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:26.903315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:26.905645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=27 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:30:26.910910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:26.911441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:26.911875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:26.913060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:26.913528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:26.913942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:26.918270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=79 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:30:26.942307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:30:27.019924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6efb78ba-85a2-4609-aa66-94a084bd1217 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "DELETE /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 204 len: 0 microversion: 2.20 time: 0.120566 Sep 01 07:30:27.020456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 827/1644] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Sep 1 07:30:26 2022] DELETE /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 07:30:27.028942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:27.029590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:27.031979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:30:27.033969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:27.034884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:27.038159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:27.038738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:27.039251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:27.040021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:27.040549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:27.041045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:27.041173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:27.041592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:27.042005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:27.042813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:27.043324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:27.043748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:27.046515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:30:27.236693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:27.239927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:27.245539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67188966-f7ce-45a0-9465-18906775f8c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.216084 Sep 01 07:30:27.246109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 828/1645] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:27 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:30:27.248791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:27.250412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:27.251614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9109439d-27a1-445d-bce6-d6226a1ea276 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1802 microversion: 2.20 time: 0.226922 Sep 01 07:30:27.252156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 818/1646] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1802 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:28.267175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:28.267779 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:28.275180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:28.276074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:28.277482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:28.278221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:28.278593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:28.279817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:28.280272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:28.280682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:28.282247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:28.282743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:28.283186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:28.283898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:28.284356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:28.284784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:28.735459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:28.744435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:28.745938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:28.747232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25c67b67-a022-4161-af6d-1541b9a6eeed tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1802 microversion: 2.20 time: 0.476702 Sep 01 07:30:28.747971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 819/1647] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1802 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:28.749505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:28.765448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9e720a4c-7b34-4986-ab34-9c8666dd5a84 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.502231 Sep 01 07:30:28.770969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 829/1648] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:28 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:29.272731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-f651c6f2-6737-40ac-a12a-80a967a80b6c req-885439ab-2fcc-4866-a302-f9110f930019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179bc01d-7bec-423c-8b0f-170bfa0d6ab0", "name": "network-vif-deleted", "tag": "a391aacc-abe6-4876-aa12-6c9d9b026042"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:30:29.283524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f651c6f2-6737-40ac-a12a-80a967a80b6c req-885439ab-2fcc-4866-a302-f9110f930019 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:29.284838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f651c6f2-6737-40ac-a12a-80a967a80b6c req-885439ab-2fcc-4866-a302-f9110f930019 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:29.285557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-f651c6f2-6737-40ac-a12a-80a967a80b6c req-885439ab-2fcc-4866-a302-f9110f930019 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:29.304687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-f651c6f2-6737-40ac-a12a-80a967a80b6c req-885439ab-2fcc-4866-a302-f9110f930019 service nova] Creating event network-vif-deleted:a391aacc-abe6-4876-aa12-6c9d9b026042 for instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 on hv-cinder-73306 Sep 01 07:30:29.319541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-f651c6f2-6737-40ac-a12a-80a967a80b6c req-885439ab-2fcc-4866-a302-f9110f930019 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141725 Sep 01 07:30:29.319541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 820/1649] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:30:29.774374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:29.775052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:29.783745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:29.784514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:29.786436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:29.786585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:29.787739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:29.789043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:29.789786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:29.790401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:29.796563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:29.804912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:29.804912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:29.804912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:29.804912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:29.805414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:29.861439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:29.886776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:29.894372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:29.898709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b62c88e-089e-48b3-8e4f-c9d58f0943a3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.128904 Sep 01 07:30:29.910342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 830/1650] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:29.971965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:29.981435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2b5aa0f1-921f-4d46-ba44-8f5a58b66325 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.198842 Sep 01 07:30:29.982798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 821/1651] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:29 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:30:30.921910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:30.922514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:30.930196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:30.930835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:30.931268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:30.932010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:30.932482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:30.932897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:31.006681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:31.007665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:31.008517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:31.015975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:31.016696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:31.017527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:31.018366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:31.018855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:31.018981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:31.019418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:31.020483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:31.021948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9b7468af-f996-42f2-b173-29ac10e26538 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.104175 Sep 01 07:30:31.022900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 831/1652] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:31.159838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:31.169691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fe08491a-0a39-4911-8c8e-a07b8dbee70d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170650 Sep 01 07:30:31.170257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 822/1653] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:30 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:30:32.046297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:32.046966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:32.053642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:32.054230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:32.054555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:32.055245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:32.055691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:32.056110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:32.120198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:32.129948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:32.131922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:32.133064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c737796-8b9d-4f48-8303-750c8aee934a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090752 Sep 01 07:30:32.133715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 832/1654] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:32.190582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:32.191222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:32.198418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:32.198904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:32.199341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:32.200042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:32.200500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:32.200952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:32.342927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:32.351353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e534d149-30fd-4e2c-8c9b-62dd3ed402e9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.164701 Sep 01 07:30:32.361741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 823/1655] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:32 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:33.155976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:33.156587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:33.164426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:33.165008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:33.165560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:33.166343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:33.166786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:33.167200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:33.235916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:33.245078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:33.246567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:33.247783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-262d9dde-afc1-4632-892a-0a609ed086d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095706 Sep 01 07:30:33.248331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 833/1656] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:33.372181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:33.372967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:33.379603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:33.380088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:33.380527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:33.381802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:33.382295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:33.382719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:33.518168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:33.527800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aac9b392-5ed4-47ab-b513-02278b8baf3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.158765 Sep 01 07:30:33.529473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 824/1657] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:33 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:34.270599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:34.271473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:34.278308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:34.278783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:34.279210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:34.279956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:34.280391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:34.280840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:34.347586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:34.357063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:34.358732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:34.359864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d28e87cd-ec79-4faf-a507-32e8adee4eac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.093338 Sep 01 07:30:34.360406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 834/1658] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:34.549381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:34.550122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:34.557271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:34.557762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:34.558203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:34.558901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:34.559356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:34.559778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:34.744362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:34.752701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d549401-29c7-4eea-9d31-565d73f8c098 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.207240 Sep 01 07:30:34.753487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 825/1659] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:34 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:35.382509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:35.383139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:35.390068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:35.390546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:35.390975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:35.391657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:35.392094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:35.392506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:35.454851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:35.464008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:35.465544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:35.466685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-464f4164-6546-4f81-9612-5ef1cbb0af2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088174 Sep 01 07:30:35.467245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 835/1660] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:35.773908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:35.774556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:35.780893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:35.781427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:35.781874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:35.782850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:35.783312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:35.783746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:35.917611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:35.925873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b6b46666-016f-4ac7-b59a-c4d494e136c4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.155832 Sep 01 07:30:35.926860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 826/1661] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:35 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:36.489729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:36.490306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:36.496713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:36.497220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:36.497645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:36.498323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:36.498761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:36.499170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:36.559875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:36.568815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:36.570287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:36.571404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b777e1ce-6ff8-480e-98f8-dd4d3dddcd19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085982 Sep 01 07:30:36.571952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 836/1662] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:36.948395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:36.949008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:36.955389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:36.955873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:36.956316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:36.957009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:36.957490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:36.957920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:37.084545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:37.092880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf698f8e-0929-43a5-9d02-d2e2e5468023 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148406 Sep 01 07:30:37.093487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 827/1663] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:36 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:37.594469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:37.595092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:37.601834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:37.602307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:37.602736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:37.603414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:37.603858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:37.604272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:37.667964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:37.676468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:37.678476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:37.679606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be947d9f-2afd-4b0b-96af-dd5de6e6d2f1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089037 Sep 01 07:30:37.680147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 837/1664] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:38.112955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:38.113610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:38.120886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:38.121417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:38.121861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:38.122557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:38.123014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:38.123472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:38.254325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:38.262693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-12d6a201-7421-43c0-839d-1a65378a2138 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.153635 Sep 01 07:30:38.263261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 828/1665] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:38 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:38.702217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:38.702802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:38.709626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:38.710090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:38.710513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:38.711183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:38.711882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:38.712299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:38.775159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:38.783596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:38.785030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:38.786197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e139006f-808d-4437-83c3-18461a3cd704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087903 Sep 01 07:30:38.786753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 838/1666] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:39.283222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:39.283918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:39.290179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:39.290654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:39.291083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:39.291768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:39.292219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:39.292639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:39.421454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:39.430095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4b9a9e19-0584-48da-9980-8c0adca13291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150787 Sep 01 07:30:39.430654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 829/1667] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:39 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:39.809522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:39.810123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:39.816439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:39.816907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:39.817376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:39.818045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:39.818557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:39.818972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:39.878671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:39.886989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:39.888411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:39.889826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b11cafb6-2b90-4857-9950-1a1a6b59c1a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084237 Sep 01 07:30:39.890369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 839/1668] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:40.451560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:40.452176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:40.458503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:40.459617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:40.460057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:40.460745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:40.461233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:40.461661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:40.590517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:40.598578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b98b5321-4ad8-47da-a2f3-eedbf3fe08d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150879 Sep 01 07:30:40.599138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 830/1669] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:40 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:40.911056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:40.911650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:40.917985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:40.918448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:40.918869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:40.919542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:40.919978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:40.920390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:40.983987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:40.992903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:40.994387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:40.995512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b36fe959-865a-45c7-a221-dc7e742dbce1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088375 Sep 01 07:30:40.996059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 840/1670] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:41.619902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:41.620536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:41.626820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:41.627300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:41.627730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:41.628413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:41.628860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:41.629311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:41.752489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:41.761492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a4d384b4-ef88-4571-8819-48d0b84a0374 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.145361 Sep 01 07:30:41.762066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 831/1671] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:41 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:42.017586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:42.018216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:42.025268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:42.025739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:42.026166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:42.026842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:42.027283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:42.027693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:42.086987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:42.095415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:42.096844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:42.098086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df600ed1-092a-45d2-87aa-349f5b4bb1f6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084635 Sep 01 07:30:42.098639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 841/1672] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:42.782602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:42.783276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:42.790224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:42.790716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:42.791155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:42.791845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:42.792300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:42.792728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:42.921841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:42.930712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0183378a-778e-46e9-8079-ce29d7983272 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151922 Sep 01 07:30:42.931286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 832/1673] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:42 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:43.119870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:43.120656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:43.127369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:43.127882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:43.128317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:43.129040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:43.129687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:43.130258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:43.132700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:30:43.192842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:43.201399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:43.202838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:43.203972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7c63d83-90a4-43d5-b25f-ed867ccce119 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087956 Sep 01 07:30:43.204529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 842/1674] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:43.951671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:43.952277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:43.958559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:43.959593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:43.960030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:43.960709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:43.961178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:43.961599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:44.089325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:44.097431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53fb8900-a9d9-46c6-8ab9-541be477fb3d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149638 Sep 01 07:30:44.097998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 833/1675] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:43 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:44.226313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:44.226947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:44.233264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:44.233744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:44.234175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:44.234852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:44.235295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:44.235711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:44.299025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:44.307510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:44.308952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:44.310114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1a0e120-fa21-4854-860b-b6f0403df43f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087726 Sep 01 07:30:44.310664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 843/1676] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:45.119322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:45.119931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:45.126285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:45.126760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:45.127188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:45.127870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:45.128322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:45.128737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:45.253942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:45.261984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af9e028d-f13e-41f1-a2e6-3ca4fb9892a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147533 Sep 01 07:30:45.262544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 834/1677] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:45 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:45.332603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:45.333229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:45.340016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:45.340490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:45.340920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:45.341631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:45.342082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:45.342501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:45.402656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:45.411078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:45.413205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:45.414337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aef5a2cb-a1ee-4836-b24d-b7e02cec5a22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085588 Sep 01 07:30:45.414895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 844/1678] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:46.283741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:46.284356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:46.291628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:46.292111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:46.292549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:46.293268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:46.293727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:46.294155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:46.308690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:30:46.423416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:46.431754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7bdcfa0d-f990-4b6c-9257-777a4b1b3db7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151885 Sep 01 07:30:46.432314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 835/1679] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:46 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:46.435700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:46.436306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:46.442627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:46.443612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:46.444044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:46.444728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:46.445199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:46.445620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:46.508063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:46.516650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:46.518121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:46.519256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0629ac19-0d52-4da3-924e-ca360f46b852 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087407 Sep 01 07:30:46.519808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 845/1680] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:47.453661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:47.454277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:47.460649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:47.461162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:47.461608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:47.462304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:47.462758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:47.463185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:47.541486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:47.542082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:47.548398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:47.548870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:47.549403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:47.550089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:47.550529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:47.550938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:47.599121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:47.607214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d0e1650c-02be-4332-86c1-5ef5a1339ed1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.157425 Sep 01 07:30:47.607994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 836/1681] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:47 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:47.614518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:47.624048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:47.625511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:47.626640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f92d326-c160-4ba1-8844-c2eb25341f48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089054 Sep 01 07:30:47.627181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 846/1682] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:48.629047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:48.629778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:48.636579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:48.637071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:48.637542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:48.638233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:48.638683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:48.639106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:48.650166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:48.650798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:48.657105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:48.657600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:48.658024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:48.658706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:48.659147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:48.659578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:48.736607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:48.745110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:48.746592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:48.747806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-720b6e5f-f17d-4b24-b68e-88a7c299eda3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.102214 Sep 01 07:30:48.748373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 847/1683] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:48.793043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:48.801360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76f87df3-d63a-4441-8355-dff5d00b63b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.176184 Sep 01 07:30:48.801929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 837/1684] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:48 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:49.770758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:49.771867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:49.778305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:49.778784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:49.779220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:49.779905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:49.780359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:49.780779 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:49.822114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:49.822843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:49.829321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:49.829809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:49.830244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:49.830939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:49.831390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:49.831812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:49.842217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:49.851466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:49.853010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:49.854210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a109e2b6-7c04-4bab-8099-903745a88cee tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087438 Sep 01 07:30:49.854773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 848/1685] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:49.961829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:49.969831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-235b9fbb-4467-4894-8a6e-b004d7e7be98 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151551 Sep 01 07:30:49.970423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 838/1686] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:49 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:30:50.876310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:50.876916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:50.883821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:50.884295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:50.884728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:50.885433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:50.885879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:50.886295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:50.947285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:50.955656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:50.957096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:50.958267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-09f8e687-4908-4332-87f4-d165ee30e8d6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085833 Sep 01 07:30:50.959464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 849/1687] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:50.991198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:50.991830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:50.998152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:50.998634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:50.999069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:50.999755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:51.000282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:51.000713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:51.124378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:51.133042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-efd7085b-9c57-46c2-86f8-1ac78c03c3e4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.145767 Sep 01 07:30:51.133630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 839/1688] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:50 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:51.980914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:51.981548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:51.987906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:51.988378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:51.988806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:51.989510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:51.990467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:51.990884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:52.054580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:52.063039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:52.064463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:52.065619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be6a39a1-e326-4d6d-9632-189d8d7ce1d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088621 Sep 01 07:30:52.066161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 850/1689] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:30:52.154205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:52.154819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:52.161175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:52.161689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:52.162132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:52.162822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:52.163274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:52.163697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:52.287907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:52.295918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1626eef0-36af-4098-96b3-1d6833060cdf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.145495 Sep 01 07:30:52.296475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 840/1690] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:52 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:53.088390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:53.088992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:53.095381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:53.095856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:53.096295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:53.096975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:53.097450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:53.097895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:53.160087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:53.168554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:53.170018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:53.171150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-053d18ae-317a-41ab-adc3-9bb87561c2c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087299 Sep 01 07:30:53.171706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 851/1691] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:53.317063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:53.317708 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:53.324478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:53.324961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:53.325429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:53.326123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:53.326576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:53.327001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:53.456664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:53.464998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-de613ce4-6d6b-4e46-a745-30b65ca2a43c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151724 Sep 01 07:30:53.465628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 841/1692] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:53 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:54.193004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:54.193647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:54.199904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:54.200371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:54.200794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:54.201577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:54.202014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:54.202427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:54.261868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:54.270541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:54.272462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:54.273619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37efbe5f-e778-48b1-b412-c0a81ff6413c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084804 Sep 01 07:30:54.274167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 852/1693] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:54.486258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:54.486822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:54.492813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:54.493328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:54.493761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:54.494443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:54.494888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:54.495308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:54.620610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:54.628647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-325647c2-0a75-4d9b-af77-cbc49f08b3d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146602 Sep 01 07:30:54.629229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 842/1694] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:54 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:55.295798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:55.296403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:55.302718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:55.303187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:55.303612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:55.304283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:55.304721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:55.305154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:55.370145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:55.378947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:55.380903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:55.382075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c50e37a3-4326-4ad7-bac3-9f0e856784ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090160 Sep 01 07:30:55.382629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 853/1695] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:55.649443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:55.650010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:55.656338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:55.656823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:55.657297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:55.657991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:55.658444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:55.658870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:55.786429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:55.794509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d91a5b1-e5b2-4d23-97cf-5a880208046d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149709 Sep 01 07:30:55.795072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 843/1696] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:55 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:56.405652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:56.406238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:56.413164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:56.413640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:56.414077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:56.414759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:56.415204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:56.415624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:56.479957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:56.488458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:56.489933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:56.491072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-056cb55c-4f5e-4301-bdfc-37bb2502a160 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089392 Sep 01 07:30:56.491624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 854/1697] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:56.815017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:56.815626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:56.822515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:56.822994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:56.823428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:56.824118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:56.824565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:56.824986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:56.952570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:56.961362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b99548d0-fff9-4428-b268-aca537bea1c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150110 Sep 01 07:30:56.961873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 844/1698] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:56 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:57.513202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:57.513808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:57.516367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:30:57.521542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:57.522047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:57.522481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:57.523161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:57.523606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:57.524022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:57.588574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:57.597216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:57.598666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:57.600328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ea01bd7-d939-4737-97e2-9374b73adc3e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.091089 Sep 01 07:30:57.600883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 855/1699] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:57.981948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:57.982566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:57.984679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=54 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:30:57.989866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:57.990353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:57.990795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:57.991520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:57.991978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:57.992406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:58.117841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:58.125960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-16dbd9dd-4ed1-4eac-a691-16ce3ee546ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147919 Sep 01 07:30:58.126520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 845/1700] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:57 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:58.623060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:58.623667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:58.630034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:58.630509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:58.630962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:58.631646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:58.632096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:58.632514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:58.695440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:58.703788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:58.705267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:58.706403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef55f000-78c2-4bba-bbdb-691c0303e400 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087322 Sep 01 07:30:58.706954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 856/1701] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:30:59.148369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:59.148975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:59.155730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:59.156208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:59.156641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:59.157358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:59.157808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:59.158227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:59.282877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:59.291049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-12e86b34-97f9-49b5-bdd1-4f7aeda0b198 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147115 Sep 01 07:30:59.291603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 846/1702] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:30:59 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:30:59.729384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:30:59.729992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:30:59.735897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:59.736371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:59.736802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:59.737509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:30:59.737952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:30:59.738400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:30:59.799042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:59.808036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:59.809510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:30:59.810649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa1922a6-484b-4e88-94d1-fa305a2c3a01 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085325 Sep 01 07:30:59.811200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 857/1703] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:30:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:00.311731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:00.312427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:00.318954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:00.319440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:00.319884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:00.320582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:00.321028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:00.321478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:00.465754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:00.474029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-af8866f0-4da4-4027-8591-168c10397d99 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166112 Sep 01 07:31:00.474600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 847/1704] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:00 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:00.833857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:00.834446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:00.840913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:00.841420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:00.841855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:00.842534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:00.842977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:00.843397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:00.905597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:00.907722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:00.915955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:00.917415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:00.918547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a391d22d-be98-4734-96a8-95391a434000 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089364 Sep 01 07:31:00.919097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 858/1705] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:01.495529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:01.496143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:01.502472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:01.502955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:01.503394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:01.504088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:01.504543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:01.504970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:01.631659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:01.640017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f964863-458d-45a5-b9b4-784644a196ca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148371 Sep 01 07:31:01.640590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 848/1706] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:01 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:01.941549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:01.942149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:01.949190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:01.949660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:01.950085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:01.950758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:01.951197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:01.951608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:02.014756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:02.023218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:02.024588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:02.025747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c27fa50-c192-44e6-ac50-c923a0d4ab32 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088061 Sep 01 07:31:02.026298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 859/1707] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:02.661591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:02.662253 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:02.668607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:02.669082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:02.669539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:02.670220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:02.670668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:02.671083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:02.797319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:02.805987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d58ea807-c8cd-4c1b-b978-0691354b372e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148362 Sep 01 07:31:02.806550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 849/1708] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:02 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:03.047984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:03.048724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:03.055835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:03.056313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:03.056751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:03.057462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:03.057913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:03.058336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:03.119690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:03.128607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:03.130094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:03.131278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0f46b20-99a0-40b0-8338-1c2d8c312c42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087267 Sep 01 07:31:03.132036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 860/1709] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:03.826571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:03.827180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:03.833459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:03.833939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:03.834402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:03.835089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:03.835536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:03.835955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:03.966836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:03.975614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0513e60d-1e04-40bc-83bc-dac9a72762c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152879 Sep 01 07:31:03.976167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 850/1710] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:03 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:04.153537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:04.154141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:04.160425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:04.160900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:04.161366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:04.162659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:04.163107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:04.163527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:04.222330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:04.231396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:04.232831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:04.233999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8eef9819-945d-486a-ba87-5c4ab44abcce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084335 Sep 01 07:31:04.234556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 861/1711] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:04.996208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:04.996831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:05.003195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:05.003682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:05.004122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:05.004817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:05.005320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:05.006400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:05.130444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:05.138554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10ae2df5-a07e-40c4-83d9-cc9fad4c4b81 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146204 Sep 01 07:31:05.139117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 851/1712] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:04 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:05.256803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:05.257451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:05.263879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:05.264611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:05.265039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:05.265747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:05.266191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:05.266610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:05.329085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:05.337552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:05.338985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:05.340197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-99d5ff0b-2586-4ed3-9c97-1016e015c663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087271 Sep 01 07:31:05.340749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 862/1713] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:06.159530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:06.160166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:06.166526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:06.167014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:06.167450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:06.168144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:06.168599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:06.169025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:06.172903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:06.293969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:06.302077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-60b17e45-3b31-4106-acfc-be6234359638 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146420 Sep 01 07:31:06.303179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 852/1714] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:06 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:06.362758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:06.363492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:06.370341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:06.370814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:06.371247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:06.371923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:06.372368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:06.372786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:06.433016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:06.441410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:06.442838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:06.444629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-518c3eef-6f00-4ff3-9197-0e14dea7dbc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085838 Sep 01 07:31:06.445190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 863/1715] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:07.324753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:07.325399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:07.331731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:07.332219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:07.332661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:07.333384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:07.334491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:07.334924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:07.460991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:07.467077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:07.467686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:07.469244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e590a2cb-07a7-42e4-90f2-d1d05533ae1b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149154 Sep 01 07:31:07.469809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 853/1716] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:07 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:07.474038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:07.474535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:07.474968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:07.475649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:07.476089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:07.476510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:07.536522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:07.544935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:07.546528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:07.547653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-44a8abdf-7831-4950-a06d-40ae7f26ba96 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084409 Sep 01 07:31:07.548209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 864/1717] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:31:08.489722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:08.490392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:08.496743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:08.497261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:08.497699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:08.498389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:08.498838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:08.499261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:08.569812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:08.570580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:08.577123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:08.577623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:08.578058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:08.578755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:08.579268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:08.579690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:08.633343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:08.642246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-87db4fa3-d036-4c41-8bdf-79ddf5b002d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.156338 Sep 01 07:31:08.642810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 854/1718] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:08 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:08.650438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:08.659041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:08.660492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:08.661677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7bc8b229-2462-4fd2-861d-b1bf3d3886f3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095866 Sep 01 07:31:08.662780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 865/1719] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:31:09.665971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:09.666561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:09.672861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:09.673364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:09.673799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:09.674478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:09.674924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:09.675357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:09.684283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:09.684896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:09.691406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:09.691882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:09.692318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:09.693530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:09.693981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:09.694410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:09.773052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:09.781671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:09.783297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:09.784432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1d804e21-a9b5-4029-a29c-f2bd87c5ce9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.104560 Sep 01 07:31:09.784983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 866/1720] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:09 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:31:09.826769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:09.835496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9bde1f35-bde9-4f02-b978-3895b9c9043a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.173421 Sep 01 07:31:09.836053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 855/1721] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:09 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:10.806670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:10.807276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:10.813653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:10.814129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:10.814563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:10.815244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:10.815686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:10.816102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:10.856298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:10.856916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:10.863264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:10.863771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:10.864205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:10.864902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:10.865370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:10.865787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:10.876259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:10.884754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:10.886225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:10.887366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-574aa5ed-3427-43ce-9d7b-9ebc0b3ff841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084626 Sep 01 07:31:10.887918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 867/1722] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:10.993647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:11.001901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54edf577-0b1f-4cd4-aeeb-82b51abf16c8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149474 Sep 01 07:31:11.002455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 856/1723] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:10 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:11.910192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:11.910797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:11.917732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:11.918206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:11.918639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:11.919316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:11.919760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:11.920178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:11.980178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:11.988764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:11.990857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:11.992000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1bc8a8d-ee19-47ee-9736-74810fc29e95 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085671 Sep 01 07:31:11.992553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 868/1724] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:12.022572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:12.023121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:12.029440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:12.029922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:12.030358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:12.031048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:12.031498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:12.031920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:12.157230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:12.165716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bbebba6c-e6ba-430b-ab98-2845f12b83b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146990 Sep 01 07:31:12.166280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 857/1725] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:12 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:13.014468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:13.015069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:13.021432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:13.021846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:13.022271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:13.022938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:13.023376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:13.023786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:13.086236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:13.094540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:13.095975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:13.097101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10b6219a-e465-4134-9b25-bc4ad4e5a73a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086879 Sep 01 07:31:13.097658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 869/1726] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:13.186955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:13.187561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:13.194489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:13.194970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:13.195399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:13.196082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:13.196531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:13.196949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:13.321542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:13.329682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f328276c-8c6a-4ca7-b9fe-d96670e12fc8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146586 Sep 01 07:31:13.330239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 858/1727] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:13 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:14.119108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:14.119696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:14.126022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:14.126489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:14.126910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:14.127587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:14.128028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:14.128440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:14.189553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:14.198511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:14.199935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:14.201060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de028bee-72c8-4ce6-bff6-651f25f95068 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085915 Sep 01 07:31:14.201652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 870/1728] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:14.350372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:14.351014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:14.357410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:14.357892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:14.358328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:14.359017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:14.359471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:14.359895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:14.489012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:14.498740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3aac9828-091b-4ef8-a9b3-92baaf983e02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152113 Sep 01 07:31:14.499414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 859/1729] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:14 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:15.223635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:15.225128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:15.231648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:15.232112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:15.232534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:15.233236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:15.233675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:15.234087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:15.296362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:15.304908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:15.306381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:15.307499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-45485d15-ed7a-4694-ac26-eb9111cfdc2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087745 Sep 01 07:31:15.308050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 871/1730] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:15.520659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:15.521755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:15.528283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:15.528812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:15.529282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:15.529982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:15.530469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:15.530894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:15.664409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:15.672806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cfa066d0-bfbf-422a-818d-ec02b672838d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.156125 Sep 01 07:31:15.673495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 860/1731] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:15 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:16.329894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:16.330545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:16.336948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:16.337532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:16.337960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:16.338684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:16.339125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:16.339539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:16.402154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:16.410551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:16.412515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:16.413675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b83872b-a859-4085-8be6-c713d6afc252 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087677 Sep 01 07:31:16.414222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 872/1732] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:16.695331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:16.695895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:16.702276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:16.702762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:16.703198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:16.703891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:16.704351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:16.704781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:16.830717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:16.839385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-318d525c-9e8b-4a0b-90f2-d5bdef8f328c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148053 Sep 01 07:31:16.839944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 861/1733] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:16 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:17.435720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:17.436318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:17.442685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:17.443763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:17.444190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:17.444865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:17.445340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:17.445757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:17.504695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:17.513780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:17.515494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:17.516607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2881266a-603b-4d11-a531-5b1261f3f722 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084784 Sep 01 07:31:17.517178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 873/1734] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:17.860746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:17.861418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:17.867719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:17.868202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:17.868640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:17.869361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:17.869817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:17.870240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:17.998486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:18.007080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2f7322a-ad2f-4a41-b89e-cbcce98c6b2f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150213 Sep 01 07:31:18.007642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 862/1735] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:17 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:18.539491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:18.540089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:18.546455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:18.546948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:18.547371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:18.548040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:18.548485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:18.548892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:18.608334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:18.616644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:18.618165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:18.619297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce50ef36-ce5f-4b57-8d70-33fcbdb35114 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084451 Sep 01 07:31:18.619841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 874/1736] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:19.027754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:19.028366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:19.034845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:19.035331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:19.035767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:19.036461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:19.036909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:19.037360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:19.163782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:19.171799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7d09f29f-fb2e-48b2-9796-bdf8ec2a45ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147910 Sep 01 07:31:19.172361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 863/1737] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:19 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:19.642138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:19.642739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:19.649017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:19.649532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:19.649939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:19.650612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:19.651051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:19.651464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:19.666234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:19.715248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:19.724911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:19.726378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:19.727508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d1339f1-5661-4ae7-8264-210ce683e86f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089510 Sep 01 07:31:19.728055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 875/1738] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:20.193439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:20.194035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:20.200547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:20.201031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:20.201503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:20.202212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:20.202693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:20.203117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:20.329717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:20.338663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1c6c8e7a-f52b-4d17-bde5-e502e7d35856 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149624 Sep 01 07:31:20.339231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 864/1739] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:20 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:20.750239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:20.750840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:20.759852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:20.760358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:20.760787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:20.761513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:20.761982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:20.762381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:20.826408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:20.835144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:20.836578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:20.837741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89e398b5-fa86-43cb-a59b-3c52a313e390 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.091480 Sep 01 07:31:20.838297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 876/1740] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:21.359706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:21.360327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:21.367641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:21.368153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:21.368592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:21.369356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:21.369815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:21.370243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:21.498042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:21.506649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f6f392c-a658-4505-9c7c-6811a8a3f1ed tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150874 Sep 01 07:31:21.507214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 865/1741] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:21 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:21.860567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:21.861265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:21.868089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:21.868557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:21.868980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:21.869680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:21.870120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:21.870530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:21.930424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:21.938823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:21.940285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:21.941434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3b4b2ba-ea94-4350-be58-2fc9c8b16b6d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084842 Sep 01 07:31:21.941978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 877/1742] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:22.528047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:22.528652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:22.535004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:22.535487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:22.535924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:22.536611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:22.537065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:22.537516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:22.660513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:22.668518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ea8f415b-f98c-4944-9be4-52edf44cf604 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.144380 Sep 01 07:31:22.669081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 866/1743] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:22 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:22.963436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:22.964042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:22.970588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:22.971064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:22.971497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:22.972178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:22.972621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:22.973040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:23.037999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:23.046396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:23.047863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:23.049006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c80000c4-37c4-443b-b26d-c976b5cd1e7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089483 Sep 01 07:31:23.049602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 878/1744] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:23.689806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:23.690420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:23.696740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:23.697269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:23.697694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:23.698388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:23.698843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:23.699275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:23.828987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:23.837850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d53dfa1-34d8-4ba3-88c9-0ba8e8a4cd09 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151917 Sep 01 07:31:23.838610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 867/1745] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:23 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:24.072912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:24.073553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:24.079963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:24.080441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:24.080875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:24.081577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:24.082022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:24.082442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:24.142732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:24.151163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:24.152604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:24.153770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1cfc0060-9beb-4e14-9a1b-6d7a7a7fae2b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085077 Sep 01 07:31:24.154326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 879/1746] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:24.858705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:24.859343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:24.865672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:24.866151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:24.866583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:24.867263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:24.867710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:24.868129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:24.996419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:24.998671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:25.006341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-884bc43d-d04e-46ae-a29b-888eddf9397d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151488 Sep 01 07:31:25.006977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 868/1747] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:24 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:25.176536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:25.177677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:25.184022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:25.184489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:25.184913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:25.185619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:25.186060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:25.186474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:25.246106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:25.254455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:25.256460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:25.257618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c9e4ecd-e2ff-48f8-9219-53ced9964705 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085006 Sep 01 07:31:25.258166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 880/1748] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:26.027572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:26.028184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:26.034553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:26.035105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:26.035551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:26.036269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:26.037980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:26.038425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:26.280318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:26.280944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:26.287468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:26.287945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:26.288374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:26.289064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:26.289527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:26.289943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:26.433836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:26.443392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:26.444982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:26.446006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d3ac30b-4e2b-4141-adc1-9d798ab27f2a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.169878 Sep 01 07:31:26.446555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 881/1749] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:31:26.522798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:26.531239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dc9cbf8e-8328-4fc7-b453-4949040086a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.507416 Sep 01 07:31:26.531744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 869/1750] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:26 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:27.468600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:27.469165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:27.476022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:27.476489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:27.476915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:27.477622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:27.478074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:27.478472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:27.541092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:27.549761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:27.551622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:27.552138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:27.552856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:27.553015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9b2a2930-78ff-4214-9889-2690c8001029 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088457 Sep 01 07:31:27.553593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 882/1751] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:27.559411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:27.559889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:27.560325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:27.561018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:27.561507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:27.561934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:27.687537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:27.696111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-969a80a8-02d7-4a48-ad95-42946f9a076e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147992 Sep 01 07:31:27.696678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 870/1752] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:27 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:31:28.574568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:28.575178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:28.577490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=56 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:28.582790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:28.583257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:28.583684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:28.584354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:28.584790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:28.585480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:28.648833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:28.657230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:28.658658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:28.659781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e5e3fa67-293d-4281-857c-48984763a1df tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089173 Sep 01 07:31:28.660334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 883/1753] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:28.717318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:28.717935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:28.719876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=52 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:28.724795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:28.725308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:28.725742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:28.727058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:28.727507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:28.727930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:28.851626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:28.859583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed18ebc1-a14f-46d0-b743-f52deca0ee60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146278 Sep 01 07:31:28.860145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 871/1754] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:28 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:29.682966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:29.683603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:29.689658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:29.690136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:29.690569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:29.691255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:29.691702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:29.692126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:29.754264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:29.766184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:29.767666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:29.768833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7be3075-e8b3-4648-b52c-b202dcee63d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090043 Sep 01 07:31:29.769425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 884/1755] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:29.879979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:29.880595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:29.887511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:29.887980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:29.888419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:29.889137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:29.889846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:29.890276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:30.019950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:30.028744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e55ec28-be27-40f9-8635-16b00f0aea86 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152684 Sep 01 07:31:30.029347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 872/1756] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:29 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:30.792072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:30.792676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:30.799026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:30.799500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:30.799933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:30.800614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:30.801054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:30.801493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:30.861280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:30.870301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:30.871793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:30.872934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16f99f8a-d4bf-4226-a24f-247d7795f841 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085272 Sep 01 07:31:30.873519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 885/1757] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:31.049414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:31.050037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:31.056402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:31.056892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:31.057369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:31.058066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:31.058526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:31.058963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:31.192888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:31.201014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ddafedd-09da-4373-a05a-b48217a16c85 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.155482 Sep 01 07:31:31.201602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 873/1758] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:31 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:31.894831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:31.895419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:31.901767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:31.902237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:31.902659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:31.903331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:31.903766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:31.904181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:31.966944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:31.975335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:31.977320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:31.978445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9608a3d-1e9f-4c1d-b4a3-e3273443943e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087479 Sep 01 07:31:31.979026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 886/1759] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:32.222528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:32.223142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:32.229579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:32.230064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:32.230502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:32.231191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:32.231647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:32.232072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:32.356250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:32.364310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c07f0ed-2c27-4297-b643-ec86498582d5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.145616 Sep 01 07:31:32.364877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 874/1760] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:32 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:33.001004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:33.001648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:33.008663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:33.009165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:33.009598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:33.010275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:33.010714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:33.011129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:33.071409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:33.079825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:33.081291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:33.082431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56f6c4bd-2224-448d-aeae-53ffa42be49a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085330 Sep 01 07:31:33.082986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 887/1761] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:33.386074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:33.386646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:33.393279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:33.393768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:33.394210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:33.394905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:33.395362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:33.395794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:33.523563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:33.533474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-052438b5-9a7a-45cf-9de5-ddd0e2de2888 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151918 Sep 01 07:31:33.534038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 875/1762] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:33 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:34.105727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:34.106379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:34.112684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:34.113182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:34.113618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:34.114296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:34.114740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:34.115237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:34.176992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:34.185462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:34.186892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:34.188020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dfac4964-f91f-4083-a245-b42a5d8295c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086891 Sep 01 07:31:34.188566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 888/1763] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:34.554864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:34.555471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:34.561807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:34.562283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:34.562732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:34.563401 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:34.563931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:34.564354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:34.688476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:34.697295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-32175b06-811c-4397-8c1e-d4660957d3f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146231 Sep 01 07:31:34.697853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 876/1764] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:34 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:35.210034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:35.210557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:35.217030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:35.217541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:35.217979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:35.218673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:35.219120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:35.219565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:35.282301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:35.291324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:35.292774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:35.293955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32e6a6a3-21ff-45d8-ab94-533f3ba06301 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087980 Sep 01 07:31:35.294513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 889/1765] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:35.717291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:35.717902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:35.724198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:35.724677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:35.725105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:35.725803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:35.726251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:35.727171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:35.857719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:35.868480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9b89b5d7-09aa-42fd-9d87-54680bbe28bc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.154160 Sep 01 07:31:35.869373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 877/1766] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:35 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:36.316635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:36.317264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:36.323661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:36.324131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:36.324557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:36.325269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:36.325713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:36.326131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:36.386005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:36.394704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:36.396140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:36.397321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d923c97-9d89-4483-b56b-15c44c991502 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084582 Sep 01 07:31:36.397874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 890/1767] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:36.889796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:36.890406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:36.897435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:36.897916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:36.898351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:36.899533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:36.899979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:36.900398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:37.028053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:37.036207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7bde4d1f-716c-492a-8aa3-435c6c27fce5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150471 Sep 01 07:31:37.036773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 878/1768] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:36 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:37.419867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:37.420413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:37.427507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:37.427980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:37.428412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:37.429091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:37.429558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:37.429973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:37.492481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:37.500845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:37.502363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:37.503496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3802db3e-ead0-4f74-b66c-73a71c8e8b39 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087592 Sep 01 07:31:37.504051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 891/1769] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:38.058251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:38.058871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:38.065282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:38.065766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:38.066206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:38.066901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:38.067356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:38.067783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:38.191422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:38.199455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb60bc3c-aa3e-4e0c-aa84-f605a5173664 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.145748 Sep 01 07:31:38.200018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 879/1770] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:38 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:38.527120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:38.527730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:38.534130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:38.534617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:38.535050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:38.535732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:38.536182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:38.536605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:38.542168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:38.609235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:38.617714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:38.619157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:38.620290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5a0a627-2b72-4bba-af53-e8c50d4f0663 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097587 Sep 01 07:31:38.620947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 892/1771] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:39.219832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:39.220418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:39.226777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:39.227258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:39.227690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:39.228375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:39.228824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:39.229272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:39.354301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:39.362448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-803a92e7-04f9-49fe-80c1-8919bfb1e2f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146514 Sep 01 07:31:39.363007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 880/1772] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:39 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:39.642548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:39.643189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:39.649645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:39.650120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:39.650551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:39.651229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:39.651672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:39.652089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:39.711751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:39.720120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:39.721593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:39.722726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-abc3e621-6b3f-4776-8cb0-74ac30720c10 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084410 Sep 01 07:31:39.723281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 893/1773] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:40.383605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:40.384258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:40.391777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:40.392199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:40.392632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:40.393367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:40.393825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:40.394255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:40.522154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:40.530332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6cb07d0f-8fdd-4aac-a95c-b4353a27b305 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150624 Sep 01 07:31:40.530897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 881/1774] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:40 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:40.745966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:40.746492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:40.752786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:40.753283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:40.753707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:40.754379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:40.754817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:40.755321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:40.815868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:40.824927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:40.826385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:40.827498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f244719-184c-4f96-a3ae-a896d616f30f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086068 Sep 01 07:31:40.828051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 894/1775] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:41.551121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:41.551762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:41.558140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:41.558623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:41.559061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:41.559753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:41.560205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:41.560628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:41.686273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:41.694371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2477bb9e-b9bc-4f78-aac9-97bedb604071 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147125 Sep 01 07:31:41.694930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 882/1776] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:41 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:41.849617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:41.850152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:41.857104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:41.857638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:41.858064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:41.858774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:41.859212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:41.859624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:41.922614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:41.931727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:41.933179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:41.934318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-efea3755-69ee-4ffa-b2e0-33c77a2e38a6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088686 Sep 01 07:31:41.934865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 895/1777] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:42.716026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:42.716637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:42.723078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:42.723554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:42.723984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:42.724666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:42.725126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:42.725551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:42.853168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:42.861196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-72fea2ba-fbc9-4278-8a11-feac4980fed0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149009 Sep 01 07:31:42.861752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 883/1778] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:42 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:42.955630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:42.956274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:42.963052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:42.963521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:42.963945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:42.964622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:42.965064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:42.965499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:43.025309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:43.033576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:43.035004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:43.036175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33e0836a-3d10-4177-b62a-bc73752a63ea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084318 Sep 01 07:31:43.036675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 896/1779] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:43.881812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:43.882419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:43.889699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:43.890174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:43.890601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:43.891283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:43.891728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:43.892145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:44.020971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:44.029208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e0edcc05-8a0d-4d63-ad59-663050a2e313 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151201 Sep 01 07:31:44.029775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 884/1780] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:43 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:44.059426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:44.060470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:44.066381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:44.066854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:44.067281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:44.068007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:44.068403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:44.068833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:44.132175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:44.141036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:44.142491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:44.143613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec80a3da-e2c3-4a89-9718-06f27e7cb3fd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088856 Sep 01 07:31:44.144166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 897/1781] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:45.049791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:45.050406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:45.057418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:45.057899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:45.058336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:45.059027 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:45.059479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:45.059902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:45.074519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:45.166171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:45.166862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:45.174128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:45.174711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:45.175143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:45.175879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:45.176319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:45.176730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:45.188665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:45.196848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56f19dbc-78da-403d-b9c0-6fc247070571 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150989 Sep 01 07:31:45.197471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 885/1782] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:45 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:45.242751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:45.251258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:45.252682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:45.253837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4f8747a-114b-44b1-b019-9333521a909c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.092212 Sep 01 07:31:45.254382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 898/1783] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:31:46.217972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:46.218586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:46.224941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:46.225494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:46.225934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:46.227144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:46.227599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:46.228025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:46.275838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:46.276430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:46.282688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:46.283240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:46.283784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:46.284465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:46.284973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:46.285783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:46.356970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:46.365316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:46.366744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:46.368522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8752794-badc-4a1f-bd86-12b52a044a34 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.096656 Sep 01 07:31:46.369086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 899/1784] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:31:46.378171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:46.386287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0c48814e-6bc1-4c19-8681-72ded0410e7f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172240 Sep 01 07:31:46.386873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 886/1785] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:46 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:47.390849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:47.391466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:47.397847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:47.398322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:47.398748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:47.399426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:47.399870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:47.400288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:47.406914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:47.407520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:47.413730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:47.414228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:47.414657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:47.415345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:47.415792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:47.416214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:47.463700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:47.472668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:47.474139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:47.475283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c3806f5-0ae3-4248-b3ea-28defc81208f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088558 Sep 01 07:31:47.475870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 900/1786] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:47.558132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:47.566121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-508fc673-ce0c-46ba-953b-70e1230c2188 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163025 Sep 01 07:31:47.566680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 887/1787] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:47 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:48.497588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:48.498177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:48.504439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:48.504902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:48.505356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:48.506033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:48.506465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:48.506876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:48.566667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:48.575704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:48.577140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:48.578276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff069e81-2236-4fb5-b03f-dd14727055fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084660 Sep 01 07:31:48.578823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 901/1788] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:48.587924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:48.588538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:48.595062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:48.595543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:48.596006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:48.596727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:48.597243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:48.597704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:48.725375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:48.733943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3578cbcb-98ee-4c6b-91a2-2c8a8bcfdd11 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150433 Sep 01 07:31:48.734507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 888/1789] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:48 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:49.601093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:49.601778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:49.608072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:49.608543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:49.608968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:49.609671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:49.610105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:49.610515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:49.673464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:49.682766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:49.684199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:49.685353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9eac7f6-3abf-4bda-8f2c-f69b88335785 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088171 Sep 01 07:31:49.685908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 902/1790] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:49.754673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:49.755292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:49.762297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:49.762785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:49.763220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:49.763917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:49.764628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:49.765051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:49.890692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:49.898796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7e005fb4-d13c-4f64-89e3-e260e2aade88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148017 Sep 01 07:31:49.899354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 889/1791] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:49 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:50.708064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:50.708657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:50.715086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:50.715558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:50.715984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:50.716658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:50.717098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:50.717531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:50.779945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:50.788394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:50.790399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:50.791514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cea8e8d-8c16-4af7-9ad0-6154bf2e192c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087357 Sep 01 07:31:50.792059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 903/1792] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:50.919950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:50.920562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:50.926869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:50.927347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:50.927776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:50.928456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:50.928902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:50.929349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:51.059674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:51.067659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8d6f96c-cade-4422-a938-02eec95598f2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151585 Sep 01 07:31:51.068222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 890/1793] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:50 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:51.814130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:51.814723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:51.821657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:51.822125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:51.822548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:51.823217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:51.823656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:51.824064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:51.886821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:51.895516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:51.896940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:51.898107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3623bd18-dd81-4ff0-868d-21b9e078aa8c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087882 Sep 01 07:31:51.898664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 904/1794] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:52.088263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:52.088903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:52.095219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:52.095698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:52.096127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:52.096842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:52.097326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:52.097769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:52.223198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:52.231897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ed0ff22-7393-4477-a2c0-ba3447af4bf3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147479 Sep 01 07:31:52.232473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 891/1795] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:52 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:52.919809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:52.920408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:52.926795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:52.927270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:52.927693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:52.928365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:52.928802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:52.929237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:52.992476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:53.002031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:53.003459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:53.004582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0db2298-97bc-46ff-ac7e-98a46d35aa13 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088694 Sep 01 07:31:53.005166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 905/1796] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:53.253090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:53.253732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:53.260821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:53.261336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:53.261774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:53.262467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:53.262920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:53.263342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:53.390896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:53.399028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-38d727be-2a5d-4db8-b1c1-caa653b052ab tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149843 Sep 01 07:31:53.399592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 892/1797] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:53 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:54.026618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:54.027218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:54.033656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:54.034123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:54.034549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:54.035215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:54.035654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:54.036064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:54.098522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:54.107722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:54.109197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:54.110339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6b5c998-d31d-4a7d-a200-58f3a3c1f0f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087579 Sep 01 07:31:54.110892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 906/1798] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:54.420342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:54.420881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:54.427223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:54.427702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:54.428140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:54.428830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:54.429317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:54.429743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:54.558998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:54.567109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7610de62-9b98-4cd2-a509-359d8093c7b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150698 Sep 01 07:31:54.567668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 893/1799] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:54 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:55.132302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:55.132933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:55.140118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:55.140683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:55.141131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:55.141804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:55.142240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:55.142652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:55.203448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:55.212849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:55.214371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:55.215506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-167aeb98-5019-46d1-9a5b-8e619ab0278b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087129 Sep 01 07:31:55.216288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 907/1800] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:55.588909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:55.589542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:55.595797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:55.596271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:55.596701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:55.597409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:55.597853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:55.598270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:55.724105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:55.732242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c69faea0-4d19-4036-939d-ebf192d0796a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147779 Sep 01 07:31:55.732816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 894/1801] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:55 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:56.238578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:56.239120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:56.246220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:56.246701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:56.247135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:56.247823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:56.248275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:56.248702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:56.314446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:56.316677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:56.324323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:56.325812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:56.326961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb890004-d395-4de4-8586-ed78023d8c85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.092492 Sep 01 07:31:56.327606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 908/1802] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:56.753506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:56.754133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:56.760938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:56.761456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:56.761891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:56.762582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:56.763030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:56.763450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:56.888448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:56.896780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da1d2547-101f-421b-89fd-a9fd804143c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147132 Sep 01 07:31:56.897390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 895/1803] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:56 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:57.349826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:57.350462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:57.357313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:57.357786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:57.358212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:57.358885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:57.359324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:57.359735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:57.420453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:57.429039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:57.430518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:57.431655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71edca59-587c-4a93-a5b5-dd02b29bf190 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086035 Sep 01 07:31:57.432205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 909/1804] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:57.918241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:57.918854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:57.924771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:57.925287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:57.925748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:57.926437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:57.926888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:57.927310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:58.058265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:58.066357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-26a7d698-407c-46b3-8c30-7146f1178531 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152174 Sep 01 07:31:58.066927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 896/1805] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:57 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:58.454150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:58.454754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:58.460865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:58.461945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:58.462373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:58.463060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:58.463500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:58.463916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:58.526746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:58.535185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:58.536606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:58.537774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-002ab1cb-3317-4dcc-be48-4f19c06b6781 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087576 Sep 01 07:31:58.538321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 910/1806] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:31:59.087246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:59.087857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:59.090140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=52 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:59.095272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:59.095757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:59.096193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:59.096885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:59.097367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:59.097792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:59.223647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:59.231650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-045872d2-e741-438f-abd3-4bec9a4f7aa4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148297 Sep 01 07:31:59.232209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 897/1807] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:31:59 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:31:59.559793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:31:59.560376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:31:59.562444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=56 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:31:59.567517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:59.567988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:59.568412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:59.569081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:31:59.569540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:31:59.569951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:31:59.632539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:59.641215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:59.642648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:31:59.643767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21b6a347-e99b-4e16-bda1-b027e0527cd9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087875 Sep 01 07:31:59.644323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 911/1808] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:31:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:00.360421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:00.361038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:00.366965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:00.367450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:00.368412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:00.369172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:00.369637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:00.370065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:00.497649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:00.506399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96afa043-19df-44b9-ae0b-bb2d4f341ebc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.258862 Sep 01 07:32:00.506899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 898/1809] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:00 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:00.667320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:00.668039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:00.674496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:00.674964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:00.675388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:00.676094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:00.676529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:00.676942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:00.736715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:00.745263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:00.746704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:00.747874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d31e99f6-ed36-4c11-bff3-8fdc8718c967 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084459 Sep 01 07:32:00.748419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 912/1810] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:01.529683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:01.530295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:01.536789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:01.537319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:01.537762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:01.538453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:01.538906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:01.539333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:01.665513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:01.673576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da691512-33b5-4c15-b2ea-273e244c1a93 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147722 Sep 01 07:32:01.674144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 899/1811] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:01 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:01.770773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:01.771380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:01.777724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:01.778231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:01.778669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:01.779345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:01.779836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:01.780202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:01.849508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:01.858092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:01.859540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:01.860683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e190814-4fea-412c-88bf-c17502959b63 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.093847 Sep 01 07:32:01.861257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 913/1812] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:02.694785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:02.695423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:02.702411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:02.702913 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:02.703332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:02.704022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:02.704473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:02.704898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:02.830642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:02.838974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c98e0411-d22f-4bbb-83d7-61621a439232 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148077 Sep 01 07:32:02.839533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 900/1813] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:02 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:02.883768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:02.884363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:02.891047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:02.891521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:02.891953 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:02.892645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:02.893089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:02.893540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:02.956631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:02.965685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:02.967122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:02.968256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9be36e8-36ce-4288-b748-ebed8caca265 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089047 Sep 01 07:32:02.968801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 914/1814] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:03.861960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:03.862564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:03.869778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:03.870250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:03.870682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:03.871363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:03.871808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:03.872226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:03.990383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:03.990983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:03.998155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:03.998623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:03.999533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:03.999722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:04.000153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:04.000564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:04.001544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:04.010364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fa4eb7c2-af0a-4f1f-aa5a-bb73a9c90bfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152469 Sep 01 07:32:04.011127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 901/1815] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:03 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:04.062637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:04.071861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:04.073373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:04.074524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0810325f-4420-4951-8fb3-ab395066f484 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088012 Sep 01 07:32:04.075087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 915/1816] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:32:05.031496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:05.032111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:05.038445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:05.038926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:05.039862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:05.040552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:05.041003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:05.041452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:05.045315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:05.096612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:05.097350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:05.104287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:05.104838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:05.105363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:05.106054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:05.106501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:05.106917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:05.172076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:05.181034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:05.182503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:05.183647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d4bb9e36-89ab-4b71-9eef-f3544ae524eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090927 Sep 01 07:32:05.184202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 916/1817] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:32:05.193203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:05.201379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c414a54d-088f-45b4-9a9d-2265e0a27847 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.173756 Sep 01 07:32:05.201938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 902/1818] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:05 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:06.205896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:06.206503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:06.212805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:06.213315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:06.213738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:06.214413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:06.214849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:06.217437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:06.221874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:06.223013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:06.230514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:06.230999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:06.231435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:06.232626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:06.233428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:06.234103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:06.288112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:06.297205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:06.298648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:06.299780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-87b9b6a8-5e63-419b-bfdc-11d971376872 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097876 Sep 01 07:32:06.300333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 917/1819] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:06.371694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:06.379740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9689f30d-741e-4eb9-bdb0-a0aa4bfc0eb5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.162014 Sep 01 07:32:06.380300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 903/1820] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:06 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:07.323115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:07.323698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:07.330080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:07.330551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:07.330977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:07.331654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:07.332095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:07.332511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:07.395058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:07.401788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:07.402402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:07.404372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:07.405870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:07.407011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-01f6cbff-5384-471a-b95d-54b48944eaa6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088339 Sep 01 07:32:07.407558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 918/1821] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:07.408575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:07.409061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:07.409541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:07.410250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:07.410689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:07.411111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:07.538821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:07.547106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8ed361c3-e6cd-4f9c-a5bc-21a9cb959b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149782 Sep 01 07:32:07.547675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 904/1822] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:07 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:08.429218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:08.429838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:08.436234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:08.436708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:08.437157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:08.437840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:08.438286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:08.438702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:08.499304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:08.507641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:08.509198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:08.510338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7a242a44-0916-4a3a-b343-39e5ae089ede tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085081 Sep 01 07:32:08.510894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 919/1823] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:08.568352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:08.568939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:08.575345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:08.575833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:08.576276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:08.576971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:08.577458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:08.577891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:08.705507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:08.714358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c0b9cc1-3642-45b3-a4d1-11dcc3a51b88 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149906 Sep 01 07:32:08.714927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 905/1824] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:08 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:09.532678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:09.533380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:09.540341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:09.540815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:09.541269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:09.541962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:09.542402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:09.542820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:09.603382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:09.611766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:09.613232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:09.614395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1859afbe-4c43-4850-ad5e-520960e924dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085677 Sep 01 07:32:09.614951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 920/1825] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:09 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:09.735088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:09.735697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:09.742169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:09.743271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:09.743739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:09.744435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:09.744888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:09.745348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:09.870139 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:09.878161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-96199577-da72-4a44-b94c-37a00f17d815 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146917 Sep 01 07:32:09.878723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 906/1826] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:09 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:10.637346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:10.637899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:10.644369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:10.644842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:10.645309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:10.645984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:10.646420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:10.646849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:10.712523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:10.721004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:10.722460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:10.723589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38226c25-10d1-4e89-b179-0d4b09a7a5dc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090312 Sep 01 07:32:10.724137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 921/1827] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:10.899697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:10.900285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:10.906686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:10.907172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:10.907612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:10.908306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:10.908760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:10.909221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:11.034487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:11.042613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6bf7733e-37e2-4b12-b9b7-226794c917e2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147400 Sep 01 07:32:11.043174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 907/1828] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:10 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:11.746698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:11.747349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:11.753651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:11.754125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:11.754550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:11.755230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:11.755671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:11.756081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:11.817136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:11.825700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:11.827143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:11.828274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a6b45aa-e7a1-434d-ac64-48abfd4a252b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086040 Sep 01 07:32:11.828830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 922/1829] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:12.063347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:12.063996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:12.070344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:12.070829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:12.071269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:12.071957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:12.072415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:12.072830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:12.198962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:12.207035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-883e6968-b93a-48b4-9425-38d47034996a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147523 Sep 01 07:32:12.207597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 908/1830] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:12 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:12.859820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:12.860418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:12.866780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:12.867757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:12.868184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:12.868854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:12.869324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:12.869736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:12.931941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:12.940369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:12.941831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:12.942949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb92dd90-ab26-4573-8f95-9ffe7324c59f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087051 Sep 01 07:32:12.943492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 923/1831] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:13.228809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:13.229582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:13.235938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:13.236433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:13.236876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:13.237595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:13.238054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:13.238483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:13.366387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:13.375328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1174df33-f06f-426d-b43a-689a766505a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151133 Sep 01 07:32:13.375896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 909/1832] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:13 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:13.965300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:13.965899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:13.972269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:13.972742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:13.973199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:13.973882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:13.974324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:13.974741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:14.038244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:14.046717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:14.048166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:14.049316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39da6b7e-c375-48bc-9b5a-84ad780378fa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088520 Sep 01 07:32:14.049869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 924/1833] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:14.396421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:14.396990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:14.403448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:14.403930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:14.404370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:14.405057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:14.405542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:14.405967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:14.533219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:14.541397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ffaac66d-4e41-447c-85ae-c62f658375f7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148902 Sep 01 07:32:14.541957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 910/1834] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:14 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:15.071790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:15.072401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:15.078830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:15.079310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:15.079746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:15.080432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:15.080880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:15.081329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:15.096427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:15.142496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:15.151490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:15.152940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:15.154107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-377a380a-9f42-4c70-afe3-e77983a141e9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086256 Sep 01 07:32:15.154657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 925/1835] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:15.562217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:15.562900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:15.569990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:15.570973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:15.571514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:15.572477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:15.572933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:15.573391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:15.700403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:15.708635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d49aa0b2-61da-418d-80cd-a8be3e124f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150316 Sep 01 07:32:15.709248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 911/1836] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:15 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:16.180084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:16.180693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:16.187037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:16.187508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:16.187955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:16.188628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:16.189097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:16.189529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:16.249773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:16.258084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:16.259506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:16.260641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1c7c1dce-0ce0-4afc-a1e3-6308426d763c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084930 Sep 01 07:32:16.261213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 926/1837] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:16.730370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:16.731009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:16.737493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:16.737981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:16.738686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:16.739846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:16.740402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:16.740830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:16.869467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:16.877743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-843bab38-39aa-455f-8378-5f3c43f79f60 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151474 Sep 01 07:32:16.878316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 912/1838] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:16 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:17.283447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:17.284075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:17.291202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:17.291671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:17.292099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:17.292772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:17.293238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:17.293703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:17.356991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:17.365577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:17.367040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:17.368192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b987a0a4-f704-404a-aec1-637c5e3052d0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089564 Sep 01 07:32:17.368739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 927/1839] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:17.900097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:17.900642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:17.907047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:17.907532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:17.907965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:17.908644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:17.909091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:17.909530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:18.037278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:18.045434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0a3b8e92-92d2-40f0-a704-29c8d9fd3efd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149776 Sep 01 07:32:18.045999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 913/1840] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:17 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:18.390164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:18.390774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:18.397189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:18.397668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:18.398099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:18.398807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:18.399250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:18.399673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:18.459991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:18.468803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:18.470310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:18.471469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e668144-35ec-494b-a88f-75cb6b270894 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085452 Sep 01 07:32:18.472025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 928/1841] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:19.066518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:19.067131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:19.073520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:19.074007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:19.074452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:19.075144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:19.075594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:19.076017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:19.203846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:19.212507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-296a7fac-df17-439b-b94a-58990ad97ef8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149860 Sep 01 07:32:19.213065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 914/1842] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:19 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:19.495901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:19.496437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:19.503116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:19.503597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:19.504031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:19.504713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:19.505183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:19.505607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:19.567309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:19.576337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:19.577965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:19.579102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b026da62-0848-4aaa-ad52-7ebd3a126ed5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087197 Sep 01 07:32:19.579654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 929/1843] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:20.233482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:20.234098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:20.240423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:20.240907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:20.241378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:20.242671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:20.243126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:20.243551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:20.367030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:20.375103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3d2b315-36f2-4b90-ae99-2eaec9706bec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.145587 Sep 01 07:32:20.375697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 915/1844] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:20 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:20.600869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:20.602231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:20.608876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:20.609386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:20.609817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:20.610497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:20.610942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:20.611358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:20.675641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:20.684180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:20.685639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:20.686782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e21c868a-7705-4681-9a5e-7c5e3f738c7b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089806 Sep 01 07:32:20.687343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 930/1845] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:21.395808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:21.396421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:21.402925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:21.403408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:21.403846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:21.404532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:21.404979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:21.405436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:21.532812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:21.541446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3ba1581-e4e3-4b8c-bcd4-c926b0fff626 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149503 Sep 01 07:32:21.542003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 916/1846] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:21 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:21.708770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:21.709390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:21.715657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:21.716125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:21.716550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:21.717246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:21.717688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:21.718099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:21.779618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:21.788228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:21.790154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:21.791284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-094f4a2f-fcd9-4248-8e39-7f441c8d4eb8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086355 Sep 01 07:32:21.791835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 931/1847] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:22.561932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:22.562553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:22.568934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:22.569457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:22.569924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:22.571189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:22.571646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:22.572073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:22.700009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:22.708134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df128c09-31b5-4b40-84e4-4660d99b6f51 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150043 Sep 01 07:32:22.708699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 917/1848] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:22 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:22.814496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:22.815035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:22.821947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:22.822419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:22.822845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:22.823520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:22.823957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:22.824371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:22.884797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:22.893531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:22.894948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:22.896071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef5200f3-20f8-45db-89e1-68dfbc271b02 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085538 Sep 01 07:32:22.896617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 932/1849] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:23.729771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:23.730314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:23.736633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:23.737128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:23.737576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:23.738264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:23.738716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:23.739142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:23.863152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:23.865491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:23.872488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c491915-6609-4bef-8fa5-4eefe8ac8a53 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146813 Sep 01 07:32:23.873056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 918/1850] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:23 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:23.917610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:23.918235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:23.924412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:23.924883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:23.925354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:23.926029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:23.926466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:23.926877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:23.990377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:23.999002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:24.000436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:24.001787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-983512b8-2cd5-4a2b-bc86-ab39234d7419 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087979 Sep 01 07:32:24.002228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 933/1851] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:24.894116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:24.894726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:24.902013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:24.902501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:24.902944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:24.903643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:24.904101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:24.904531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:25.025609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:25.026221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:25.031273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:25.032975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:25.033492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:25.033922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:25.034619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:25.035066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:25.035485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:25.040518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7186e806-be53-4d38-b4d4-7525f95a595d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150001 Sep 01 07:32:25.041091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 919/1852] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:24 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:25.095782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:25.105085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:25.106535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:25.107658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-878c125a-27c7-40c2-bbd1-ae1136008629 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086579 Sep 01 07:32:25.108219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 934/1853] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:32:26.061872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:26.062492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:26.068814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:26.069339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:26.069785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:26.070479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:26.070950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:26.071370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:26.128958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:26.129596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:26.136031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:26.136515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:26.136948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:26.137662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:26.138138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:26.138555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:26.246321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:26.254769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:26.256223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:26.257374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-772e94ac-14f9-495b-ab89-ade2ec483d60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.132449 Sep 01 07:32:26.257937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 935/1854] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:32:26.305861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:26.314445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b791130-8a21-4571-aa8b-da6157df69ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.256327 Sep 01 07:32:26.314964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 920/1855] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:26 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:27.280266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:27.280863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:27.287183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:27.287665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:27.288080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:27.289375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:27.289817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:27.290239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:27.335064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:27.336260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:27.342466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:27.342944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:27.343376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:27.344064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:27.344510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:27.344928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:27.355671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:27.364248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:27.365721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:27.366865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ad45c90-cc63-4df1-a30f-a39ae026cf65 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090519 Sep 01 07:32:27.367448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 936/1856] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:27.475348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:27.483496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-381314f6-c7fe-4a01-8b1a-b58a725c03cf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152265 Sep 01 07:32:27.484067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 921/1857] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:27 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:28.390691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:28.391287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:28.398801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:28.399390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:28.399910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:28.400732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:28.401203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:28.401619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:28.463097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:28.471674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:28.473225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:28.474456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63fd1aa5-7604-4c5f-8baf-4e3b5ecfd00c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088696 Sep 01 07:32:28.475088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 937/1858] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:28.504226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:28.504865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:28.511254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:28.511736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:28.512167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:28.512848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:28.513338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:28.513755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:28.644051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:28.652366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e7da1b8-697e-4ed8-b59c-aa875e4de0b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152104 Sep 01 07:32:28.652932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 922/1859] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:28 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:29.498140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:29.499101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:29.505172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.505658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.506094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.506781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.507234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.507651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.573020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:29.581568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:29.583008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:29.584161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b6e48726-5003-477b-8be7-8722383e6cdb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090778 Sep 01 07:32:29.584718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 938/1860] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:29.653390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:29.654588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:29.657080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=52 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:29.662398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.662884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.663323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.664630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.665083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.665534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.672900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:29.673556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:29.675342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=56 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:29.682310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.682793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.683222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.683913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.684358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.684776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.708610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:32:29.795840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f727cdd-49a7-4c20-8371-b7b84ff7acd4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 204 len: 0 microversion: 2.1 time: 0.147541 Sep 01 07:32:29.796535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 923/1861] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:32:29 2022] DELETE /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:32:29.801665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:29.802251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:29.811323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.812336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.812969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.814231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.815192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.815556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.833465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:29.842368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9368c083-2575-4994-b4d4-944710bc72af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.173113 Sep 01 07:32:29.842871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 939/1862] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:29 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:29.846699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:32:29.847976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:29.848593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:29.855086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.855556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.856225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.857142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.857824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.858248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.934392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-38d6bcf6-eeb6-4919-b329-1c5011bd34b1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 204 len: 0 microversion: 2.1 time: 0.136431 Sep 01 07:32:29.934978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 924/1863] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:32:29 2022] DELETE /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:32:29.945842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:29.946540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:29.952957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.953471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.953901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.954590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:29.955037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:29.955457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:29.990248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:29.998667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8ecbe38-8c27-444d-8285-801fdac54b8c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.154818 Sep 01 07:32:29.999254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 940/1864] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:30.091390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:30.099490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-46888c70-e6e2-48fd-b00c-42a1b7183e63 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.159800 Sep 01 07:32:30.099983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 925/1865] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:30.607080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:30.607682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:30.614178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:30.614649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:30.615080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:30.615756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:30.616200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:30.616617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:30.683762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:30.692164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:30.693633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:30.694759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b4cea54-b1ea-4495-ac78-03f1b5a75ef6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.091699 Sep 01 07:32:30.695344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 941/1866] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:30.862866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:30.863476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:30.869935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:30.870422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:30.870872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:30.871567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:30.872024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:30.872454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:31.002548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:31.011043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85c72dc1-c0cf-4e46-bf1b-f91f652a6df0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152102 Sep 01 07:32:31.011611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 926/1867] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:30 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:31.020044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:31.020659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:31.031515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:31.031994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:31.032428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:31.033138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:31.033593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:31.034017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:31.037886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:31.120328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:31.120984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:31.127301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:31.127794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:31.128240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:31.128954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:31.129440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:31.129874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:31.484406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:31.490797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:31.492762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-782e5645-54e8-467e-b571-de1b84bc3562 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.476526 Sep 01 07:32:31.493437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 942/1868] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:31.498952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-336633cc-36e1-4135-b768-80b5ff2d4758 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.382553 Sep 01 07:32:31.499510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 927/1869] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:31.716343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:31.716891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:31.723509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:31.723981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:31.724405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:31.725076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:31.725539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:31.725952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:31.790163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:31.798652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:31.800449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:31.801673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58eef148-3066-468a-ad1c-4468c6bb14c9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089365 Sep 01 07:32:31.802221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 943/1870] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:32:32.036118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:32.036723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:32.043516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:32.043993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:32.044424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:32.045107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:32.045574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:32.045996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:32.174256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:32.182899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9fd324e-796c-48c6-b00d-46feca5467d4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150599 Sep 01 07:32:32.183458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 928/1871] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:32 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:32.513546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:32.514081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:32.519715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:32.520270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:32.520401 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:32.520742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:32.521198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:32.521881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:32.522324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:32.522739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:32.526692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:32.527169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:32.527599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:32.528277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:32.528728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:32.529161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:32.713160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:32.716761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:32.722351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b105f04e-d952-4c65-9ca3-a75a9c05d8de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212705 Sep 01 07:32:32.722920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 944/1872] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:32.725420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55c2c711-601d-4651-9a0b-e87392888651 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209393 Sep 01 07:32:32.726057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 929/1873] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:32.824782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:32.825413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:32.831260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:32.831732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:32.832156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:32.832827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:32.833299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:32.833749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:32.893841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:32.902914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:32.904324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:32.905494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2bd08d65-9036-4a03-8e06-6ab0e2406e99 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084527 Sep 01 07:32:32.906048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 945/1874] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:33.203003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:33.203617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:33.210010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:33.210493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:33.210933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:33.211617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:33.212069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:33.212489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:33.348235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:33.356370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-58ab940f-61dc-41b3-8447-a79a563edda6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.157238 Sep 01 07:32:33.356973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 930/1875] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:33 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:33.743531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:33.744076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:33.746507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:33.747329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:33.750497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:33.750968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:33.751396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:33.752082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:33.752521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:33.752935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:33.753210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:33.753670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:33.754110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:33.754816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:33.755286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:33.755702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:33.945508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:33.949648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:33.953867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f514ca35-4db9-49f7-8de4-9ad6c379cce1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214786 Sep 01 07:32:33.954430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 946/1876] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:33.957928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed2d38ae-6707-4777-b626-e4a55d258e9f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215183 Sep 01 07:32:33.958635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 931/1877] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:33.959101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:33.959797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:33.965918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:33.966390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:33.966933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:33.967613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:33.968052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:33.968463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:34.030247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:34.039789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:34.041386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:34.042565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c68277ad-575b-431f-a41e-15e8ef69d801 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087207 Sep 01 07:32:34.043114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 947/1878] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:34.377418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:34.378031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:34.384892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:34.385406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:34.385842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:34.386533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:34.386988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:34.387407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:34.391632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:34.516106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:34.524914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-299a83e5-6b7e-4e17-a65d-1cf67ed3fe4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151457 Sep 01 07:32:34.525510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 932/1879] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:34 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:34.974609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:34.975214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:34.979678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:34.980289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:34.982117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:34.982586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:34.983013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:34.983687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:34.984125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:34.984536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:34.986236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:34.986719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:34.987158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:34.987845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:34.988304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:34.988728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:35.173622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:35.176594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:35.182716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6aa2444-f6d7-442e-9be8-6362af0488fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211904 Sep 01 07:32:35.183288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 948/1880] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:35.185390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-25878034-e759-4da3-b0dc-8aaf63b8386a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210020 Sep 01 07:32:35.186105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 933/1881] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:35.188007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:35.188603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:35.194335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:35.194819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:35.195251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:35.195934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:35.196376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:35.196795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:35.261850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:35.270698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:35.272127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:35.273340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fcf7d3ee-e6af-42d6-b164-76511ec2a337 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089110 Sep 01 07:32:35.273902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 949/1882] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:35.546280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:35.546895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:35.553238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:35.553721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:35.554759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:35.555477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:35.555927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:35.556353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:35.682677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:35.690746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d0f565d-2613-4c28-a873-65de8d719c6a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148386 Sep 01 07:32:35.691309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 934/1883] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:35 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:36.203841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:36.204446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:36.205964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:36.206580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:36.211376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:36.211854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:36.212388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:36.213265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:36.213650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:36.213767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:36.214067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:36.214280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:36.214719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:36.215417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:36.215874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:36.216299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:36.401798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:36.405881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:36.411366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0de2cb1-0790-41b9-ab08-37192877d783 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209205 Sep 01 07:32:36.412154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 935/1884] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:36.414131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25159a5f-8936-4faa-ab44-f0a5c7423019 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214208 Sep 01 07:32:36.415312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 950/1885] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:36.417840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:36.418635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:36.424635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:36.425137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:36.426215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:36.426581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:36.427028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:36.427446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:36.488215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:36.496550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:36.498003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:36.499133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-71f31e71-2d89-4b9e-9a94-5e403775d104 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086197 Sep 01 07:32:36.499681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 936/1886] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:36.713026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:36.713660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:36.719776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:36.720255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:36.720731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:36.721462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:36.722056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:36.722533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:36.881048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:36.889176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f4b8197-c1f2-4cb5-a300-5cc6b1679139 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.180715 Sep 01 07:32:36.890012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 951/1887] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:36 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:37.434251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:37.434833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:37.435237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:37.435344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:37.441345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:37.441489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:37.441825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:37.441950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:37.442254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:37.442368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:37.442937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:37.443230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:37.443499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:37.443607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:37.443783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:37.443903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:37.629751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:37.634285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:37.638532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a44f9db6-fbcf-421c-bcec-9c8f43b90826 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208001 Sep 01 07:32:37.639111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 952/1888] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:37.642730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07165359-48bf-4a50-9ea3-c74cbf93c8b8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212268 Sep 01 07:32:37.643425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 937/1889] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:37.643803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:37.644404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:37.650116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:37.650592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:37.651015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:37.651711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:37.652152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:37.652566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:37.715848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:37.724348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:37.725842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:37.726980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ce367a7-18a4-4c80-89ac-7fdf8191bf9e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086703 Sep 01 07:32:37.727533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 953/1890] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:37.910709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:37.911244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:37.917084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:37.917591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:37.918024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:37.918703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:37.919148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:37.919567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:38.047941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:38.056693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f0d7048d-8171-41b0-a8fd-bd100d944b01 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149909 Sep 01 07:32:38.057291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 938/1891] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:37 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:38.659484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:38.660035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:38.662136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:38.662743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:38.667123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:38.667597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:38.668027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:38.668712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:38.669182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:38.669605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:38.669710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:38.670104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:38.670557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:38.671223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:38.671671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:38.672090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:38.870172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:38.874205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:38.878286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e8e0386-a654-431e-b0cd-83592d66e5a7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.222686 Sep 01 07:32:38.878851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 954/1892] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:38.883850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:38.884445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:38.886057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-056c40db-0fdb-42bc-89de-de5f39f082d4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.227634 Sep 01 07:32:38.886914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 939/1893] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:38.890423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:38.890897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:38.891330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:38.892014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:38.892458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:38.892875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:38.953361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:38.962493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:38.963948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:38.965088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e50d7f47-8aaf-4568-a6dd-2188f750f729 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085337 Sep 01 07:32:38.965666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 955/1894] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:39.077395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:39.078046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:39.084018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:39.084506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:39.084978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:39.085704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:39.086164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:39.086591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:39.214072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:39.222153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da8161a6-6307-4f49-833a-74526c8c0ac4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148661 Sep 01 07:32:39.222717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 940/1895] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:39 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:39.900236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:39.900846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:39.906708 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:39.907273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:39.907404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:39.907754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:39.908184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:39.908870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:39.909345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:39.909762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:39.914246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:39.914736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:39.915179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:39.915876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:39.916333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:39.916763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:40.099369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:40.109926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-768f987a-10c0-4a02-8b5a-451efd7f83d4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214076 Sep 01 07:32:40.110504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 956/1896] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:40.114906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:40.115092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:40.115605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:40.121377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:40.121849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:40.122277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:40.122957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:40.123077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f62b2d2-3299-4be3-ac44-9f73e20b0741 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220113 Sep 01 07:32:40.123395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:40.123680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 941/1897] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:40.123929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:40.185488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:40.193807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:40.195770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:40.196895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8971d9b-e649-44e2-9218-0561f884bcd3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085485 Sep 01 07:32:40.197479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 957/1898] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:40.242728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:40.243350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:40.249298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:40.249784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:40.250244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:40.250919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:40.251995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:40.251995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:40.381510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:40.390475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9caee7d-c0da-409f-a3b8-b6afe9ff9c8e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151556 Sep 01 07:32:40.391047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 942/1899] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:40 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:41.130909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:41.131547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:41.138457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:41.138930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:41.139359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:41.140298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:41.140743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:41.141193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:41.144177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:41.144797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:41.151878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:41.152370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:41.152814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:41.153546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:41.154008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:41.154441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:41.331914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:41.334144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:41.338755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:41.341468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b1c9898a-211d-4f9f-81de-6af6dd581a76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214267 Sep 01 07:32:41.342047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 958/1900] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:41.346478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:41.347123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eba148b7-e760-401f-a4ba-9d0f25586841 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.207343 Sep 01 07:32:41.347258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:41.354545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 943/1901] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:41.354709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:41.354709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:41.354709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:41.354709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:41.355038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:41.355278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:41.412274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:41.412802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:41.415516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:41.418712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:41.419197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:41.419634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:41.420331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:41.420785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:41.421277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:41.423988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:41.425477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:41.426603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04a6f3ba-45d9-4a13-91c4-cf7c4a970327 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.083648 Sep 01 07:32:41.427164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 959/1902] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:41.548087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:41.556732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-258dd0a5-e89d-4bf0-9d23-e7f415144c54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148359 Sep 01 07:32:41.557330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 944/1903] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:41 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:42.362089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:42.362679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:42.367786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:42.368394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:42.369072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:42.369579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:42.370022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:42.370709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:42.371153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:42.371572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:42.374837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:42.375323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:42.375761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:42.376453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:42.376906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:42.377350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:42.562113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:42.566020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:42.570802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0b763a5-5ef0-4704-a11c-66c5c848403d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212599 Sep 01 07:32:42.572902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 960/1904] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:42.574641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3daf3dd1-4223-4a8d-8497-0946c7ac59b3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210628 Sep 01 07:32:42.585777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 945/1905] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:42.585951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:42.585951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:42.585951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:42.585951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:42.586301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:42.586301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:42.586301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:42.586868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:42.590098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:42.590708 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:42.596605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:42.597090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:42.597555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:42.598247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:42.598700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:42.599179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:42.649140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:42.657665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:42.659104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:42.660242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82199721-dd51-4ad3-bd66-955ca7d87bf5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086401 Sep 01 07:32:42.660807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 961/1906] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:42.738498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:42.746590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c69344f-cd69-4152-82b5-7558ca853195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170200 Sep 01 07:32:42.747150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 946/1907] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:42 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:43.593952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:43.594552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:43.595326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:43.595939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:43.601744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:43.602220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:43.602646 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:43.602765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:43.603255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:43.603373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:43.603695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:43.603878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:43.604166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:43.604417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:43.604872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:43.605329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:43.795973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:43.798940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:43.804276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15056659-2adb-4c06-b1d6-581666b6eaac tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214209 Sep 01 07:32:43.804866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 962/1908] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:43.807586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca1a103d-dcdc-4450-b995-7ff54a000c48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215860 Sep 01 07:32:43.808277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 947/1909] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:43.809316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:43.809908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:43.815711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:43.816182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:43.816603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:43.817767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:43.818214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:43.818702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:43.822126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:43.822757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:43.828460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:43.828933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:43.829399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:43.830081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:43.830534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:43.830951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:43.884164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:43.893091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:43.894543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:43.895676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ea91c4f-7aac-4fe0-bb01-df16b9e0faca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089871 Sep 01 07:32:43.896226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 963/1910] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:43.976055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:43.978237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:43.985370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-88140318-98ad-4302-9c5d-29fca86d8ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166805 Sep 01 07:32:43.985934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 948/1911] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:43 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:44.825308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:44.825911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:44.832395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:44.832864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:44.833319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:44.834163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:44.834605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:44.835021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:44.835663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:44.836292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:44.842676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:44.843205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:44.843656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:44.844360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:44.844818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:44.845276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:45.023185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:45.029765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:45.031429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1d642294-f8f9-40c7-b794-86d75e6b6efa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210062 Sep 01 07:32:45.032072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 964/1912] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:45.036787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:45.037424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:45.038115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-711dfba5-406f-4fe3-a421-c474f729ef33 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213286 Sep 01 07:32:45.046932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 949/1913] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:45.046932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:45.047207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:45.047307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:45.047398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:45.047398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:45.047398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:45.047398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:45.047711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:45.049934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:45.051649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:45.051649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:45.051649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:45.052093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:45.052520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:45.128304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:45.136901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:45.138386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:45.139797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-739990b8-d204-41d0-b39d-513486f12a6c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.106543 Sep 01 07:32:45.140357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 965/1914] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:45.192783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:45.200916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-38ee2bb7-3a9b-48b6-9164-22992594c41f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.160810 Sep 01 07:32:45.201508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 950/1915] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:45 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:46.055236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:46.055859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:46.059770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:46.060438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:46.062590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:46.063070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:46.063506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:46.064198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:46.064670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:46.065089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:46.066712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:46.067197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:46.067634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:46.068324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:46.068786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:46.069235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:46.270469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:46.273392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:46.278736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08c22463-c835-4a42-844a-aba83721020d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.227991 Sep 01 07:32:46.279298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 966/1916] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:46.281637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5258a3a8-15d0-4247-b5b2-bf0be0daf3ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.225665 Sep 01 07:32:46.282363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 951/1917] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:46.283709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:46.284306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:46.290455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:46.290927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:46.291353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:46.292024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:46.292465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:46.292878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:46.298420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:46.299043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:46.305628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:46.306049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:46.306485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:46.307182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:46.307633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:46.308058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:46.357468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:46.366030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:46.368046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:46.369208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12b557db-d811-4124-bdb5-6d379968e01f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088988 Sep 01 07:32:46.369770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 967/1918] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:46.449457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:46.457783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a2f6c494-fb30-4ffd-8478-d5c6f298fbfe tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163687 Sep 01 07:32:46.458346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 952/1919] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:46 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:47.299926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:47.300518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:47.307741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:47.307957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:47.308385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:47.308532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:47.308647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:47.309408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:47.309854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:47.310385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:47.316683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:47.317193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:47.317630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:47.318337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:47.318787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:47.319211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:47.496168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:47.502586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:47.504293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-854dc93b-16fd-43d2-8f59-c8c3f1981cd3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208191 Sep 01 07:32:47.505162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 968/1920] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:47.510108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:47.510706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:47.511559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5eb80894-7888-4a04-821e-115165e35de8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208599 Sep 01 07:32:47.512413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 953/1921] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:47.516659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:47.517286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:47.522946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:47.523100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:47.523494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:47.523612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:47.523912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:47.524051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:47.524596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:47.524713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:47.525038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:47.525195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:47.525483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:47.525598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:47.608226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:47.616997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:47.618985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:47.620146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-048d8dfa-7632-4dd4-9b73-7faab46ca5ec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.114355 Sep 01 07:32:47.620877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 969/1922] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:47.679321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:47.687626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-adf12d09-280e-46c2-87b3-6e93d5b7e340 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.174603 Sep 01 07:32:47.688185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 954/1923] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:47 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:48.525762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:48.527751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:48.532793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:48.533051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:48.533526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:48.533637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:48.533741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:48.534382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:48.534823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:48.535240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:48.540605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:48.541088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:48.541567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:48.542265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:48.542724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:48.543150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:48.721876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:48.726411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:48.731020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2cbe8c9-5c64-4ef1-badf-65ba731b0197 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208986 Sep 01 07:32:48.731593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 970/1924] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:48.745022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ade11653-7f4f-4e2f-b880-cbb89e24a0f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.205830 Sep 01 07:32:48.745022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 955/1925] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:48.745295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:48.745295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:48.745466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:48.745466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:48.745623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:48.745623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:48.745623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:48.745623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:48.745927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:48.745927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:48.746781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:48.747643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:48.748260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:48.748951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:48.749431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:48.749851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:48.832682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:48.841846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:48.843282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:48.844441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-559a0125-e16a-449f-9cdf-8d024db5dd22 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.111923 Sep 01 07:32:48.845014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 971/1926] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:48.908108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:48.916999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5afa7506-f31c-4caf-a007-27414e52b574 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.180591 Sep 01 07:32:48.917601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 956/1927] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:48 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:49.752795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:49.753654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:49.756566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:49.757929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:49.760808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:49.761318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:49.761745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:49.762440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:49.762881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:49.763295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:49.763989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:49.764736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:49.765207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:49.766013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:49.766357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:49.766784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:49.952940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:49.955952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:49.961248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84a912a4-5984-4a80-8c94-822283515e58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212579 Sep 01 07:32:49.961872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 972/1928] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:49.963981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c363675c-d76d-4328-9f5f-d6e4efd03cf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211272 Sep 01 07:32:49.966462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:49.967056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:49.969763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 957/1929] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:49.973322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:49.973934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:49.974503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:49.975247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:49.976381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:49.976882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:49.980626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:49.981266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:49.987020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:49.987500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:49.987933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:49.988616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:49.989063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:49.989511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:50.051630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:50.060659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:50.062147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:50.063275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1298d683-a45d-4852-9831-46e35c8d09ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.100329 Sep 01 07:32:50.063826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 973/1930] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:50.134969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:50.144403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8470d0ce-50b5-4f0f-944c-5d816d56f5cb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.173780 Sep 01 07:32:50.144969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 958/1931] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:49 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:50.981689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:50.982432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:50.985207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:50.985821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:50.988957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:50.989455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:50.989885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:50.990558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:50.990998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:50.991409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:50.991991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:50.992501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:50.992934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:50.993642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:50.994094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:50.994515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:51.172407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:51.181081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f1e518a-b888-4d5a-9b2f-68d593fca9c5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.203243 Sep 01 07:32:51.181643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 974/1932] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:51.183701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:51.186221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:51.186824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:51.192240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b839ba1-1292-4c70-9ce0-270150c2f45a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210938 Sep 01 07:32:51.192461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:51.192943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:51.193415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:51.194103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:51.194978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 959/1933] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:51.195126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:51.195553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:51.199752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:51.200352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:51.205988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:51.206473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:51.206905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:51.207590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:51.208038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:51.208457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:51.210484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:51.261452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:51.270338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:51.271776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:51.272930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42a9328e-831a-4b53-9962-748c72ced1aa tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090384 Sep 01 07:32:51.273524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 975/1934] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:51.351854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:51.359857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18e9dbe1-4321-413d-b872-e48acbdc00c1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163629 Sep 01 07:32:51.360409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 960/1935] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:51 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:52.202164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:52.202792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:52.209268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:52.209744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:52.210773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:52.211457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:52.211899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:52.212315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:52.214750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:52.215385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:52.221653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:52.222134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:52.222567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:52.223256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:52.223735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:52.224157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:52.416372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:52.419508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:52.424787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-878a3de8-7d8c-4215-8c25-2c1fde8a6677 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.226480 Sep 01 07:32:52.425408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 976/1936] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:52.429891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:52.430486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:52.435975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-00a5472c-23f0-4ecd-a095-fa17c56276d0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.224964 Sep 01 07:32:52.436419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:52.436938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:52.437184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 961/1937] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:52.437528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:52.438237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:52.438739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:52.439167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:52.441946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:52.442582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:52.450120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:52.450610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:52.451044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:52.451773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:52.452275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:52.452813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:52.511827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:52.520523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:52.521989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:52.523712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5803df71-ab3c-4d73-89c5-0990c8937704 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097388 Sep 01 07:32:52.524269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 977/1938] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:52.599622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:52.607720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-92d1c297-4001-4a69-8495-9e03956114f9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.169654 Sep 01 07:32:52.608290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 962/1939] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:52 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:53.445782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:53.446375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:53.452965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:53.453481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:53.453915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:53.454603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:53.455049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:53.455468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:53.458478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:53.459087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:53.465924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:53.466407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:53.466859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:53.467533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:53.467983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:53.468404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:53.646552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:53.652839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:53.655466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bfec9634-d48d-4934-929e-be4dd025541e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213459 Sep 01 07:32:53.656472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 978/1940] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:53.659572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68278740-edeb-478d-bc06-7dfcc69e49b5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.204726 Sep 01 07:32:53.674636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 963/1941] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:53.674853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:53.674853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:53.675073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:53.675073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:53.675234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:53.675234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:53.675234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:53.675234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:53.675545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:53.675635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:53.675718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:53.675809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:53.675892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:53.675892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:53.675892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:53.675892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:53.762617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:53.772147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:53.774301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:53.775462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff26eee2-655e-4ee3-ad5b-ac48440df56b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.117787 Sep 01 07:32:53.776248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 979/1942] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:53.826293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:53.834503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-281ed74c-f871-4b1f-97fd-d1c76823f331 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.173454 Sep 01 07:32:53.835688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 964/1943] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:53 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:54.677362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:54.677967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:54.681907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:54.682512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:54.684998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:54.685507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:54.685935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:54.686618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:54.687061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:54.687478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:54.688835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:54.689365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:54.689799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:54.690484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:54.690932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:54.691352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:54.705896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:54.875635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:54.878777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:54.883793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7a8cf29-d520-4e3d-b7c5-87acacaa3103 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210335 Sep 01 07:32:54.884478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 980/1944] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:54.887608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c8387ba3-c727-4b5c-90f3-368d712d8815 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210103 Sep 01 07:32:54.901174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 965/1945] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:54.901412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:54.901412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:54.901604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:54.901604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:54.901852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:54.901852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:54.901852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:54.901852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:54.902203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:54.902203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:54.902382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:54.902382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:54.902382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:54.902382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:54.902704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:54.902930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:54.966983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:54.975701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:54.977781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:54.978952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2d00972-5285-4b91-a5e0-b8d01d39b984 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.093571 Sep 01 07:32:54.979508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 981/1946] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:55.052092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:55.060206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-873d0902-e17b-481d-8fee-f9b3b9b91173 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171119 Sep 01 07:32:55.060763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 966/1947] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:54 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:55.904806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:55.905438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:55.911420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:55.911950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:55.912079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:55.912423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:55.912857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:55.913578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:55.914527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:55.914951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:55.915070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:55.920322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:55.920799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:55.921266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:55.921958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:55.922407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:55.922825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:56.115295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:56.119001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:56.124300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3159174-322f-4089-b8f8-538ccb0146d3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.223267 Sep 01 07:32:56.124875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 982/1948] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:56.128074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d769546-c09a-4363-8e98-05526fecdc13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220238 Sep 01 07:32:56.129343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:56.129938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:56.135732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:56.136208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:56.136847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:56.137575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:56.138023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:56.138611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:56.142249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 967/1949] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:56.147092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:56.147705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:56.153462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:56.153950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:56.154394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:56.155089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:56.155543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:56.155960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:56.210857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:56.220338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:56.221803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:56.222948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e84a41b-ee26-4dfc-a558-b91884137206 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097132 Sep 01 07:32:56.223501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 983/1950] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:56.302970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:56.311780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-66eb2175-29ee-425a-88b4-fc0c065ea69f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.168334 Sep 01 07:32:56.312350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 968/1951] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:56 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:57.145481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:57.146005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:57.148499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:57.149603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:57.152585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:57.153062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:57.153525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:57.154216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:57.154663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:57.155083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:57.155440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:57.155953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:57.156384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:57.157068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:57.157542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:57.157960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:57.586767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:57.593359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:57.594868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dad46ef8-5cff-48fc-adf8-b0fa4d6ff8b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.453297 Sep 01 07:32:57.595438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 984/1952] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:57.600663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:57.601362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:57.602318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4eb4261b-aa72-4720-946f-6cfb7c8b957e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.456989 Sep 01 07:32:57.602878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 969/1953] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:57.607485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:57.608287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:57.608703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:57.609261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:57.609894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:57.610580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:57.611082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:57.611551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:57.614066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:57.614547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:57.615017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:57.616129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:57.616269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:57.616598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:57.696630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:57.705048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:57.706510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:57.707643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6009df40-1444-4fba-8f00-28a46789d0d7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.110567 Sep 01 07:32:57.708194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 985/1954] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:57.762359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:57.770927 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b32da243-6436-4e5c-91ec-0a036f1a6010 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166932 Sep 01 07:32:57.771531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 970/1955] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:57 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:58.615777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:58.616423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:58.623336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:58.623503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:58.623913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:58.624028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:58.624238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:58.624956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:58.625432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:58.625858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:58.629925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:58.630407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:58.630843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:58.631529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:58.631977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:58.632400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:58.813452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:58.817398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:58.822335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4a9e543-609c-499e-b0a0-f89a57b5cabd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.202734 Sep 01 07:32:58.822905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 971/1956] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:32:58.826030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f29384a-3737-4cfa-b24f-c083ed48e3a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214046 Sep 01 07:32:58.826853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 986/1957] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:58.828398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:58.829022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:58.835082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:58.835596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:58.836033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:58.836720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:58.837389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:58.837934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:58.840215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:58.840816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:58.846543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:58.847020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:58.847451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:58.848133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:58.848592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:58.849007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:58.906605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:58.916011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:58.917523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:58.918657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d09662ac-d06d-4ad1-ac02-f14c01c700c8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.094083 Sep 01 07:32:58.919218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 972/1958] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:32:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:32:58.987900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:32:58.996571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7dfb099-b772-4270-b95c-29a7157d8bf1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.160066 Sep 01 07:32:58.997152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 987/1959] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:58 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:32:59.843117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:59.843733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:59.847063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:32:59.847667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:32:59.849676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:32:59.850489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:59.850912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:59.851343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:59.852549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:59.853019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:59.853600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:59.855131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:59.855601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:59.856024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:32:59.856692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:32:59.857145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:32:59.857560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:00.045621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:00.048638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:00.053869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-89c91824-34bc-4833-89be-d752bc471b21 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214594 Sep 01 07:33:00.054714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 973/1960] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:00.056885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dfbd9b31-24f6-482f-81b3-5a6b0471bb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213578 Sep 01 07:33:00.069241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 988/1961] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:32:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:00.069421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:00.069421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:00.069633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:00.069633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:00.069838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:00.069838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:00.069838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:00.069838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:00.070195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:00.070290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:00.070384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:00.070476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:00.070476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:00.070476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:00.070476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:00.070832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:00.140205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:00.149409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:00.150848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:00.151985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8db6891b-c4e3-404c-aff3-6ba17e9ff0d2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.096494 Sep 01 07:33:00.152545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 974/1962] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:00.226276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:00.235055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-268d8121-7d82-4ca1-8377-74dad1043903 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.176413 Sep 01 07:33:00.235614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 989/1963] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:00 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:01.075463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:01.076081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:01.079686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:01.080289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:01.082477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:01.082959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:01.083393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:01.084083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:01.084537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:01.084960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:01.086328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:01.086799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:01.087225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:01.087956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:01.088394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:01.088808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:01.271447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:01.278631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:01.279962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22580174-3cda-469a-b3e5-d6a4a83ea03f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208380 Sep 01 07:33:01.280625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 975/1964] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:01.285239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:01.285915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:01.286838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-038ecb0f-881d-4e62-b982-e93ed371a91a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210788 Sep 01 07:33:01.287575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 990/1965] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:01.292311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:01.292901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:01.298638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:01.299118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:01.299579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:01.299975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:01.300269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:01.300589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:01.300750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:01.301169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:01.301313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:01.301980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:01.302494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:01.302972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:01.387405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:01.396115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:01.397582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:01.398728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-379bd39e-c84f-4b01-abd0-7b2b4ac785eb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.117085 Sep 01 07:33:01.399291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 976/1966] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:01.452068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:01.460276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f6a52b1-d3d6-45c8-bdd3-522eda10c29e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171882 Sep 01 07:33:01.460857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 991/1967] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:01 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:02.301363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:02.302741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:02.308414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:02.309017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:02.309951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:02.310435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:02.310870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:02.311615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:02.312068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:02.312490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:02.315228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:02.315696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:02.316119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:02.317445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:02.317902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:02.318546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:02.324119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:02.510061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:02.512955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:02.518542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-970a60a8-db28-4c68-b2a2-1352cadea476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.221089 Sep 01 07:33:02.519113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 977/1968] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:02.521391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-90a0128c-ffcf-467b-8470-ef5351656ee0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217268 Sep 01 07:33:02.522115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 992/1969] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:02.523519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:02.524122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:02.529809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:02.530317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:02.530739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:02.531433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:02.531888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:02.532326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:02.534998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:02.535601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:02.541392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:02.541865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:02.542293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:02.543005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:02.543449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:02.543865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:02.601757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:02.610438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:02.611868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:02.613008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab0db2f4-1b4d-4893-8f30-e4de5dc9c49f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.092993 Sep 01 07:33:02.613603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 978/1970] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:02.688629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:02.696737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-41bdc9ce-dd61-4b81-a272-2c8b88267827 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166895 Sep 01 07:33:02.697339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 993/1971] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:02 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:03.540106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:03.540697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:03.541895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:03.542539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:03.547338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:03.547816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:03.548250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:03.548937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:03.549057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:03.549410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:03.549578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:03.549830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:03.549941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:03.550629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:03.551077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:03.551497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:03.749685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:03.754532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:03.760830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e667b96a-f07d-435b-af89-b0e134f6f5b3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.222681 Sep 01 07:33:03.766051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f48289ec-728f-428f-a2c5-4663d47cafaa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.229997 Sep 01 07:33:03.774582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 994/1972] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:03.779137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 979/1973] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:03.780683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:03.781338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:03.783821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:03.784398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:03.787556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:03.788038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:03.788473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:03.789488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:03.789935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:03.790412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:03.790601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:03.791088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:03.791520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:03.792217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:03.792665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:03.793084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:03.878335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:03.887558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:03.888997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:03.890431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddc7f902-0398-4512-b62c-55b10066099b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.114660 Sep 01 07:33:03.891140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 995/1974] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:03.945824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:03.954007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7fbff213-5af3-44bd-81d8-109dab4c6c25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.173875 Sep 01 07:33:03.954576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 980/1975] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:03 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:04.782521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:04.783130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:04.787650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:04.788322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:04.790336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:04.790813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:04.791242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:04.791931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:04.792371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:04.792788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:04.795075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:04.795555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:04.795995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:04.796684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:04.797156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:04.797585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:04.979965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:04.986603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:04.988438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-421a9c17-77bf-4f76-b777-48520b540301 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209718 Sep 01 07:33:04.989101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 996/1976] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:04 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:04.993660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:04.994335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:04.995852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a95cd4ea-80bf-42cc-93b1-d12026dfe64f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212007 Sep 01 07:33:04.996582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 981/1977] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:05.000155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:05.000640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:05.001070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:05.001772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:05.002221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:05.002637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:05.005488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:05.006091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:05.012307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:05.012790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:05.013265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:05.013959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:05.014406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:05.015076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:05.019067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:05.072670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:05.081336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:05.082774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:05.083916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8c36dc0-4aff-448c-b46b-12d0ce36e7f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.093824 Sep 01 07:33:05.084469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 997/1978] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:05.154141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:05.162114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c345685-f029-47ec-a39b-50282ee7ca0c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.160712 Sep 01 07:33:05.162667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 982/1979] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:04 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:06.009727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:06.010326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:06.017020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:06.017577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:06.017858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:06.018268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:06.018478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:06.018594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:06.019017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:06.019426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:06.025408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:06.025897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:06.026341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:06.027041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:06.027498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:06.027924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:06.210689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:06.214903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:06.218947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd1596f6-ac34-44d0-93f2-17f831e102d7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213587 Sep 01 07:33:06.219518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 998/1980] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:06.223189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6f719a34-8478-46dc-9b63-4c6c6536f8ce tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209443 Sep 01 07:33:06.223910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 983/1981] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:06.224042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:06.224481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:06.229400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:06.230156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:06.230279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:06.230647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:06.231075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:06.231838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:06.232192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:06.232604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:06.237105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:06.243752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:06.244737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:06.245509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:06.245980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:06.246416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:06.298147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:06.308397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:06.309930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:06.311131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56f88680-7cb4-4117-8257-888914c06912 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090675 Sep 01 07:33:06.311691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 999/1982] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:06.395053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:06.403229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6de592c6-1b01-44a6-9169-b43bb2ca0fd0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.178565 Sep 01 07:33:06.403793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 984/1983] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:06 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:07.255913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:07.256515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:07.258718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:07.259354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:07.263069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:07.263546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:07.263975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:07.264934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:07.265400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:07.265819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:07.265968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:07.266448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:07.266881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:07.267567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:07.268011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:07.268434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:07.459636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:07.463710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:07.468051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-02037716-80d6-4897-90e0-55bebefed35c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213220 Sep 01 07:33:07.468621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 985/1984] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:07.472027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13945f6c-4e33-4f83-879e-18fedbd63097 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220149 Sep 01 07:33:07.472807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1000/1985] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:07.473329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:07.473939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:07.480271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:07.480761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:07.481233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:07.482043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:07.482508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:07.482934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:07.486819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:07.487496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:07.493852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:07.494395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:07.494825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:07.495500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:07.495937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:07.496351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:07.546808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:07.555597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:07.557046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:07.558231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1e8c08e-2e28-4760-a941-9e9a32f4a907 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088671 Sep 01 07:33:07.558796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 986/1986] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:07.635461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:07.643761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4581469c-16d2-48bd-b8b6-379acf93597f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.160619 Sep 01 07:33:07.644318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1001/1987] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:07 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:08.488878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:08.489514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:08.493001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:08.493448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:08.495967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:08.496464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:08.496904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:08.497629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:08.498083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:08.498512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:08.499614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:08.500093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:08.500529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:08.501244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:08.501706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:08.502129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:08.692672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:08.696939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:08.701554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c992651a-2adf-4bc4-9ec9-c6bc50b6bc9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216494 Sep 01 07:33:08.702131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 987/1988] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:08.705076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-630292a1-06f4-40f9-9013-dc1068db9050 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216217 Sep 01 07:33:08.717161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1002/1989] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:08.717358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:08.717358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:08.717542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:08.717542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:08.717715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:08.717715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:08.717715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:08.717715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:08.718021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:08.718021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:08.718184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:08.718184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:08.718184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:08.718792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:08.719238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:08.719654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:08.788482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:08.797098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:08.798570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:08.799713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eaf3cc1a-993d-4305-af71-57568e830647 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.096675 Sep 01 07:33:08.800282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 988/1990] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:08.869903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:08.877997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-809f46cc-033c-4a8e-b2c4-ee5cfd01875f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171125 Sep 01 07:33:08.878562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1003/1991] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:08 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:09.723730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:09.724326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:09.726822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:09.727419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:09.731231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:09.731713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:09.732161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:09.732844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:09.733326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:09.733682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:09.733789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:09.734152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:09.734584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:09.735262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:09.735698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:09.736111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:09.928232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:09.931207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:09.936516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-21edb2c0-0106-4e4d-aab8-499b2cbdfc4c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216677 Sep 01 07:33:09.939432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74c1aefd-3319-4b1f-b82e-6db379a90694 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216835 Sep 01 07:33:09.943590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 989/1992] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:09.948718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:09.949432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:09.949698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1004/1993] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:09.954328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:09.955005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:09.955356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:09.955837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:09.956299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:09.957044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:09.957526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:09.957949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:09.961371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:09.961844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:09.962274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:09.962947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:09.963389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:09.963803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:10.028145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:10.036695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:10.038172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:10.039877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7eb3bc0f-cb4d-48bd-966a-772486594723 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095220 Sep 01 07:33:10.040628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 990/1994] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:09 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:10.112525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:10.120629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1252331c-b2e5-4f23-a91b-684891e21890 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.169897 Sep 01 07:33:10.121201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1005/1995] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:09 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:10.957245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:10.957864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:10.959828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:10.960432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:10.964241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:10.964724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:10.965197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:10.965893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:10.966344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:10.966625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:10.966764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:10.967095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:10.967549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:10.968223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:10.968661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:10.969075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:11.156801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:11.160398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:11.165596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-89cacca5-274c-409f-8e31-5bf4a8522086 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212234 Sep 01 07:33:11.177326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 991/1996] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:11.177545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5bd895c-0371-42ca-9541-7b95c4cc2adf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213278 Sep 01 07:33:11.177545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1006/1997] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:11.177726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:11.177726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:11.177901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:11.177901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:11.178072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:11.178072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:11.178072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:11.181046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:11.181199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:11.181312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:11.181608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:11.181726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:11.182156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:11.182841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:11.183288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:11.183709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:11.263093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:11.272362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:11.274382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:11.276262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e6a3ba1-852a-43f3-8f8d-f2293256726a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.108473 Sep 01 07:33:11.277232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 992/1998] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:11.330110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:11.338839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c46c8a4-2996-4945-a715-7f0974d7040d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.168338 Sep 01 07:33:11.339409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1007/1999] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:11 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:12.188775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:12.189517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:12.190737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:12.191347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:12.196609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:12.197104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:12.197576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:12.198276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:12.198393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:12.198733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:12.198847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:12.199165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:12.199270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:12.199846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:12.200294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:12.200711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:12.387760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:12.392003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:12.394173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:12.397230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c1f6ba4-ea24-4b83-b1b3-db1b8ecb4fdb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212356 Sep 01 07:33:12.397814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 993/2000] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:12.401558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b34dcef-8223-4cc7-99b0-60d490706d7d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214563 Sep 01 07:33:12.402308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1008/2001] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:12.406531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:12.407128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:12.412871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:12.413319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:12.413448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:12.414306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:12.414526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:12.414993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:12.415436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:12.415854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:12.421838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:12.422323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:12.423367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:12.424070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:12.424519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:12.424939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:12.507295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:12.516116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:12.517566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:12.518710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ade891f-6425-4df7-b7a0-d254ab7ff0bc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.119939 Sep 01 07:33:12.519270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 994/2002] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:12.567323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:12.575283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0631122c-3d67-4b2e-b03f-214d65c58865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172248 Sep 01 07:33:12.575833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1009/2003] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:12 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:13.418937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:13.419732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:13.424627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:13.425259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:13.426169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:13.426653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:13.427087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:13.427774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:13.428221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:13.428641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:13.431436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:13.431909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:13.432338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:13.433025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:13.433495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:13.433914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:13.621761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:13.624600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:13.630101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8366840-0264-4bba-b38f-4cd6d47b6004 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209090 Sep 01 07:33:13.630665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1010/2004] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:13.633369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dcce0517-84bf-4cb5-b3ca-d4fb5c3ee791 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217719 Sep 01 07:33:13.644436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 995/2005] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:13.644649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:13.644649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:13.644850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:13.644850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:13.645031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:13.645031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:13.645031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:13.645031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:13.645386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:13.645473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:13.645562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:13.645645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:13.645645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:13.646411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:13.646992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:13.647309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:13.711541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:13.720238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:13.721729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:13.722874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb1103d2-b253-440d-adbd-52fc65089f4a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.091304 Sep 01 07:33:13.723434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1011/2006] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:13.794800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:13.802908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5c2ded2f-6184-4737-bf7b-99769333a2ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.168067 Sep 01 07:33:13.803473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 996/2007] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:13 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:14.652431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:14.653036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:14.653940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:14.654550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:14.659419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:14.659894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:14.660318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:14.660777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:14.660993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:14.661294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:14.661459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:14.661729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:14.661871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:14.662414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:14.662864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:14.663283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:14.851818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:14.858449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:14.859935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c3dbda41-10bc-4b98-ba95-4c92e9231063 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209839 Sep 01 07:33:14.860500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 997/2008] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:14.866730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05417b20-f265-4775-af46-f449d98c4948 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218630 Sep 01 07:33:14.867421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1012/2009] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:14.871639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:14.872232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:14.875760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:14.876429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:14.877792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:14.878269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:14.878700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:14.879374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:14.879812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:14.880226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:14.882858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:14.883349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:14.883810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:14.884512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:14.884967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:14.885424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:14.971138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:14.973325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:14.981150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:14.982583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:14.983721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28fc85a2-4c05-4558-83e7-3175ffd3e24e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.122324 Sep 01 07:33:14.984277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 998/2010] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:15.032510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:15.040538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-491d11ce-57af-4e54-8bef-8e754cae4550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172335 Sep 01 07:33:15.041090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1013/2011] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:14 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:15.881092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:15.881829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:15.887584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:15.888216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:15.889030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:15.889805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:15.890271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:15.890964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:15.891553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:15.891986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:15.894489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:15.894955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:15.895378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:15.896055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:15.896497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:15.896908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:16.079441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:16.083357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:16.087575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55100aa3-b922-47e3-a55e-0fc6c2d00a93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.203694 Sep 01 07:33:16.088135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1014/2012] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:16.091686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30abbc4c-24d7-4ada-b659-03683c5d24cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214453 Sep 01 07:33:16.092386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 999/2013] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:16.096576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:16.097211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:16.102766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:16.103247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:16.103691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:16.104381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:16.104839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:16.104969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:16.105296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:16.105506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:16.111457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:16.111931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:16.112354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:16.113028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:16.113494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:16.113924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:16.190836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:16.199305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:16.200941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:16.202098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-877d7113-9541-4f5a-8c77-7c03c0ff6b9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.112947 Sep 01 07:33:16.202652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1015/2014] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:16.257044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:16.265444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d3d0616b-1776-4f41-be65-26009648db02 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172244 Sep 01 07:33:16.266011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1000/2015] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:16 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:17.108013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:17.108616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:17.111528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:17.112145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:17.114627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:33:17.114776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:33:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 (ip 10.222.0.46) !!! Sep 01 07:33:17.115178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:17.115662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:17.115823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:33:17.115823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:33:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 (ip 10.222.0.46) !!! Sep 01 07:33:17.116088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:17.117397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:17.118060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:17.118263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:17.125825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:17.126309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:17.126745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:17.127443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:17.127893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:17.128318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:17.308045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:17.312198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:17.316263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-326a9c1e-3799-4a7e-8bde-259b99ecdff9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212021 Sep 01 07:33:17.316832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1016/2016] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:17.320539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c46382f6-5eb5-4c3c-a458-7dab2f6586b8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212804 Sep 01 07:33:17.333345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1001/2017] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:17.333549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:17.333549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:17.333756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:17.333756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:17.333968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:17.333968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:17.333968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:17.333968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:17.334350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:17.334350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:17.334526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:17.334526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:17.334526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:17.335079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:17.336073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:17.336501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:17.414496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:17.422993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:17.424448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:17.425628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06a0e485-c900-4910-a26c-6989cf08f48b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.107191 Sep 01 07:33:17.426191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1017/2018] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:17.480363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:17.488556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dcbccb94-5d16-4be3-bbf5-9c7255035f4e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166500 Sep 01 07:33:17.489136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1002/2019] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:17 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:18.338580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:18.339305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:18.341298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:33:18.341423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:33:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a (ip 10.222.0.46) !!! Sep 01 07:33:18.342851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:33:18.343012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:33:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a (ip 10.222.0.46) !!! Sep 01 07:33:18.343809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:18.344427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:18.344557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:33:18.344676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:33:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a (ip 10.222.0.46) !!! Sep 01 07:33:18.350866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:18.352045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:18.352490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:18.353218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:18.353676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:18.354101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:18.359589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:18.360702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:18.361157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:18.363150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:18.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:18.363848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:18.550133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:18.554107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:18.558428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6e3fd07f-8a15-4c82-96d2-796278384e6e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218582 Sep 01 07:33:18.558996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1003/2020] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:18.562293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61f0f9b1-2768-4ba9-b940-d94bcf81cb47 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.228115 Sep 01 07:33:18.563008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1018/2021] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:18.563455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:18.564071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:18.570296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:18.570774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:18.571261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:18.571966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:18.572421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:18.572850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:18.580296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:18.580909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:18.587354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:18.587826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:18.588252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:18.588991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:18.589396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:18.589811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:18.635256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:18.644205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:18.645669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:18.646863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9862ac1e-f743-4492-bbf9-ca47d2bc58ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086913 Sep 01 07:33:18.647428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1004/2022] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:18.728952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:18.737095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5cf41c78-a5e3-41dd-a539-3df3aa0e1975 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.162857 Sep 01 07:33:18.737687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1019/2023] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:18 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:19.579646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:19.580256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:19.587366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:19.587850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:19.588099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:19.588531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:19.588708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:19.588964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:19.589449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:19.589877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:19.595082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:19.595555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:19.595986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:19.596670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:19.597128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:19.597558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:19.788235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:19.795924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:19.796865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca33c54a-4248-41f6-ac9e-0ab6d6afba27 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.221040 Sep 01 07:33:19.797480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1005/2024] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:19.802025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:19.802576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:19.804405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1bfcd099-f6dd-4e5a-8aad-b8372b2bb8dc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220588 Sep 01 07:33:19.805350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1020/2025] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:19.809708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:19.810296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:19.815743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:19.816211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:19.816643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:19.817339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:19.817788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:19.818199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:19.820355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:19.820847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:19.821315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:19.822013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:19.822467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:19.822891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:19.903613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:19.912188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:19.914254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:19.915403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-345f14ec-ffc0-4447-a96f-612fc38fe169 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.117002 Sep 01 07:33:19.915977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1006/2026] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:19.965232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:19.973436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa9e824e-42ed-4f2c-915b-3af6e9d1cd1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.167239 Sep 01 07:33:19.973992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1021/2027] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:19 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:20.817969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:20.818580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:20.824914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:20.825428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:20.825866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:20.826558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:20.827015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:20.827441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:20.832952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:20.833574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:20.840074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:20.840554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:20.840985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:20.841701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:20.842152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:20.842570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:21.017704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:21.025044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:21.026228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2fd36ddb-fe17-48bd-96b4-2f94c84c9995 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212040 Sep 01 07:33:21.026802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1007/2028] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:21.031342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:21.031946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:21.033706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64f9723c-3c97-49ed-9b67-6c310b93a124 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.204480 Sep 01 07:33:21.034401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1022/2029] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:21.039234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:21.039834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:21.043666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:21.044233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:21.044746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:21.045540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:21.045659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:21.046016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:21.046137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:21.046446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:21.046560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:21.047224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:21.047665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:21.048085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:21.136427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:21.145174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:21.146650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:21.148340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f353526e-cf40-4689-9585-121e70087f43 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.120120 Sep 01 07:33:21.148898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1008/2030] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:21.198971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:21.207098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42654f66-c393-40d1-a3bb-10a752826e07 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171916 Sep 01 07:33:21.207663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1023/2031] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:21 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:22.047507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:22.048118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:22.055105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:22.055491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:22.056011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:22.056011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:22.056199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:22.056671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:22.057133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:22.057559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:22.062328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:22.062808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:22.063236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:22.063915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:22.064357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:22.064772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:22.246579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:22.249839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:22.254841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cf71424-8c0e-46bc-a503-c5b8b212d23a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211103 Sep 01 07:33:22.255505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1009/2032] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:22.258243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c1c5b0a-89ce-456b-ae7e-c274c08f837a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.207026 Sep 01 07:33:22.258959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1024/2033] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:22.260170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:22.260883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:22.265926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:22.266938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:22.267067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:22.267423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:22.267863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:22.268555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:22.269007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:22.269462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:22.274087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:22.274572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:22.275001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:22.275700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:22.276146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:22.276593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:22.291976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:22.347646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:22.356655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:22.358108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:22.359246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-583cfb9b-5ee6-48de-9746-3542c28ae6ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.102766 Sep 01 07:33:22.359803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1010/2034] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:22.432285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:22.440281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4aeec64-2645-4067-a956-b5096670633d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.179790 Sep 01 07:33:22.440834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1025/2035] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:22 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:23.277533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:23.278152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:23.279892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:23.280622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:23.284712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:23.285221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:23.285661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:23.286362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:23.286816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:23.286930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:23.287245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:23.287401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:23.287832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:23.288515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:23.288960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:23.289410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:23.729983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:23.731825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:23.738320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2574c46-c564-43be-ba0f-433b2b967a71 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.462370 Sep 01 07:33:23.740166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84c76322-9369-43c2-89a1-918503356544 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.467308 Sep 01 07:33:23.740984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1011/2036] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:23.744837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1026/2037] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:23.745867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:23.746616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:23.752385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:23.752862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:23.753388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:23.754617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:23.755328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:23.758451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:23.759064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:23.759502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:23.765895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:23.765895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:23.765895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:23.765895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:23.766357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:23.766357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:23.828365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:23.837029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:23.838499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:23.839645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8706d185-9db1-4dca-ad1d-15b1dba844ca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097845 Sep 01 07:33:23.840208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1012/2038] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:23.909608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:23.918497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-232d55ca-5b49-4f58-b35e-64eca639c335 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172449 Sep 01 07:33:23.919063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1027/2039] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:23 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:24.762188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:24.762728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:24.763082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:24.763212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:24.769851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:24.770323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:24.770474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:24.770743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:24.770856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:24.771239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:24.771424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:24.771861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:24.771981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:24.772274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:24.772380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:24.773485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:24.963328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:24.966671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:24.974398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9fd0c4c1-11c8-4183-8f46-4045717dcf34 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215932 Sep 01 07:33:24.974744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5cfd7fc4-ef2a-4f31-8bbc-a5c95c7aa5b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216316 Sep 01 07:33:24.974987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1013/2040] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:24 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:24.975308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1028/2041] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:24.979668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:24.980255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:24.986117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:24.986584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:24.987004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:24.987674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:24.988301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:24.988698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:24.994149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:24.995193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:25.009229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:25.009730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:25.010173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:25.010933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:25.011382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:25.011812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:25.082283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:25.090837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:25.092320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:25.093512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd7cdd58-b3cb-496e-9d3e-945e495eccc5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.104552 Sep 01 07:33:25.094109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1014/2042] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:25.138226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:25.146873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10ef7175-096b-4391-bc2c-ccfa61affefa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170590 Sep 01 07:33:25.147436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1029/2043] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:24 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:25.996175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:25.996760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:25.997165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:25.997368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:25.999223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=96 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:26.003861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:26.004337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:26.004528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:26.004772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:26.005017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:26.005483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:26.005616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:26.005930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:26.006186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:26.006353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:26.006647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:26.007077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:26.022378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:26.197733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:26.200523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:26.205983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e2d34a67-b371-4fc0-8df5-e234f5f1d6a9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214244 Sep 01 07:33:26.206561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1015/2044] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:26.208657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c3664414-d902-4f99-bac5-6776eb96abdb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215732 Sep 01 07:33:26.221137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1030/2045] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:26.221340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:26.221340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:26.221515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:26.221515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:26.221679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:26.221679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:26.221679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:26.221679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:26.221979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:26.222084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:26.222174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:26.222174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:26.222330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:26.222428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:26.222428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:26.222428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:26.293007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:26.301615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:26.303062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:26.304273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-20dabcce-542f-4968-ae2c-1bbdaccf151d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.096727 Sep 01 07:33:26.304840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1016/2046] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:26.384681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:26.393028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eae15d4f-91ad-4f74-a3ee-59ed82200a4b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.182601 Sep 01 07:33:26.393618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1031/2047] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:26 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:27.228344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:27.229103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:27.232589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:27.233211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:27.235604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:27.236088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:27.236522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:27.237234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:27.237689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:27.238110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:27.238938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:27.239408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:27.239831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:27.240502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:27.240942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:27.241380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:27.426046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:27.432727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:27.434150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2080892a-2b1e-4780-b5d6-455725f48e5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210217 Sep 01 07:33:27.434728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1017/2048] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:27.439102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:27.439710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:27.440945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb7977e5-627c-4b9c-98b4-c3867169c811 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212573 Sep 01 07:33:27.446540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:27.447025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:27.447463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:27.448157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:27.448607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:27.449028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:27.452687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1032/2049] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:27.457641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:27.459450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:27.466242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:27.466729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:27.467199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:27.467957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:27.468343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:27.468767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:27.512080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:27.521063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:27.522522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:27.524262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a5b4b12e-1c28-499b-802c-44d1d0d5067c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088628 Sep 01 07:33:27.524823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1018/2050] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:27.605851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:27.614000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e279e6f8-0653-444c-b2f4-7e26720095a6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.160064 Sep 01 07:33:27.614568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1033/2051] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:27 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:28.455519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:28.456163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:28.462645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:28.463150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:28.463514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:28.463969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:28.464283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:28.464733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:28.465001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:28.465374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:28.483424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:28.483966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:28.484588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:28.485289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:28.485835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:28.486266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:28.659665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:28.668888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e93f4171-4b85-49d7-8073-f7f3b6d374c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217065 Sep 01 07:33:28.669497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1019/2052] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:28.671104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:28.674333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:28.674929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:28.679511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aaac787c-7a09-4122-a8f7-3215b603afe6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220756 Sep 01 07:33:28.680343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1034/2053] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:28.684193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:28.684590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:28.684829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:28.685370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:28.685518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:28.686084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:28.686540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:28.686967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:28.691382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:28.691963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:28.692488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:28.693382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:28.693927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:28.694434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:28.774773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:28.783410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:28.784937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:28.786194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-437d3b70-cada-4566-bd0c-fbe6b9945d42 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.115783 Sep 01 07:33:28.786837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1020/2054] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:28.840566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:28.848618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-edb3e0e4-5fb3-47d0-8923-35bc81cc5e7c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.167478 Sep 01 07:33:28.849189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1035/2055] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:28 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:29.690049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:29.690656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:29.697084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:29.697599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:29.698042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:29.698740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:29.699195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:29.699621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:29.700527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:29.701145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:29.706986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:29.707455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:29.707881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:29.708548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:29.708988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:29.709431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:29.894188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:29.897085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:29.903312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cf950c2-e649-4e31-a0f3-1ea8ca40d1f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216983 Sep 01 07:33:29.903895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1021/2056] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:29.905965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af1e5718-6ed9-4248-bc66-8f674c341619 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209345 Sep 01 07:33:29.918034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1036/2057] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:29.918243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:29.918243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:29.918726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:29.918726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:29.918947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:29.918947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:29.918947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:29.919215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:29.919321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:29.919321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:29.919321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:29.919573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:29.919573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:29.919573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:29.919573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:29.919948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:29.920294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:30.001904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:30.011090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:30.012770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:30.013974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f86e9c73-32e0-460c-9cf0-1cfc224f4cec tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.109145 Sep 01 07:33:30.015118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1022/2058] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:29 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:30.070322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:30.078449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4518928c-73f3-4ca5-84f8-930f155e20f8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170891 Sep 01 07:33:30.079008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1037/2059] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:29 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:30.923344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:30.923985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:30.930065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:30.930543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:30.930673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:30.931026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:30.931467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:30.932162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:30.932616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:30.933037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:30.936549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:30.937886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:30.938777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:30.939475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:30.939918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:30.940333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:31.126968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:31.133604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:31.135127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76cf4d15-db00-479a-bab1-6f47cec2465a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215677 Sep 01 07:33:31.135699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1023/2060] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:31.140409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:31.141013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:31.142058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29852aac-0666-465b-a572-fc809a30a564 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216146 Sep 01 07:33:31.142818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1038/2061] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:31.146721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:31.147415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:31.148226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:31.148712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:31.149043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:31.149792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:31.150251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:31.150773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:31.154994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:31.155583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:31.156085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:31.156851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:31.157335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:31.157754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:31.219537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:31.228403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:31.229869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:31.231006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd7a8bf9-91ac-463b-bc38-107a95c0dd56 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.094395 Sep 01 07:33:31.231771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1024/2062] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:31.299927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:31.307907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4baba271-47c7-44e2-8992-4b9d6a0ca7ae tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163944 Sep 01 07:33:31.308464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1039/2063] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:31 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:32.156630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:32.157278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:32.163949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:32.164675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:32.164804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:32.165194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:32.165635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:32.166318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:32.166765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:32.167184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:32.170959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:32.171438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:32.171867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:32.172545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:32.172989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:32.173434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:32.359355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:32.362801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:32.367689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6fe183e5-8819-403b-8eb4-193bdbc4f4c2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214883 Sep 01 07:33:32.368270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1025/2064] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:32.372682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:32.373072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-365df4d0-c33d-4b4e-97dd-2583e9a9f1bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213000 Sep 01 07:33:32.373335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:32.373991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1040/2065] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:32.379324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:32.379814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:32.380252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:32.380952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:32.381440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:32.381875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:32.388260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:32.388950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:32.395046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:32.395519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:32.395944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:32.396617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:32.397056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:32.398005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:32.445923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:32.454525 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:32.455973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:32.457137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-76ebada7-78e3-48f7-be7f-788fd1d8f653 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087939 Sep 01 07:33:32.457709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1026/2066] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:32.541463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:32.550276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7add2fa-9c0f-4218-988a-1fec77ff6703 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.165752 Sep 01 07:33:32.550831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1041/2067] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:32 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:33.388390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:33.389006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:33.395151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:33.395814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:33.395932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:33.396305 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:33.396751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:33.397478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:33.397938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:33.398391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:33.402131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:33.402600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:33.403022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:33.403692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:33.404133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:33.404545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:33.408391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:33.590634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:33.594616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:33.598926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5595f581-d2aa-431b-b6aa-414a38056fef tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214384 Sep 01 07:33:33.599485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1027/2068] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:33.603115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f54f9ea-2c6a-4807-a4ff-f223f01f284a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211706 Sep 01 07:33:33.613297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1042/2069] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:33.613487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:33.613487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:33.613665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:33.613665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:33.613817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:33.613817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:33.613817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:33.613817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:33.614126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:33.614126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:33.614309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:33.614641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:33.614943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:33.615617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:33.616059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:33.617072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:33.704259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:33.712852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:33.714394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:33.715529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-41327eea-9fd9-4295-964e-d37974a6cfe9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.115137 Sep 01 07:33:33.716082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1028/2070] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:33.768194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:33.776429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21691adf-6abd-4b9b-93c6-8a1f2fde5960 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171863 Sep 01 07:33:33.776985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1043/2071] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:33 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:34.620298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:34.620915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:34.624263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:34.624868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:34.627359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:34.627848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:34.628285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:34.628973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:34.629453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:34.630099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:34.631454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:34.632518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:34.632946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:34.633971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:34.634411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:34.634823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:34.820482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:34.823585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:34.829456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8bf6715d-80ee-4b6c-a22b-a71eaef0a83c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208816 Sep 01 07:33:34.830022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1044/2072] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:34.831588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28e687a4-e861-4fb4-9fee-d204fb2cf3e7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215717 Sep 01 07:33:34.845062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1029/2073] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:34.845282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:34.845282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:34.845479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:34.845479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:34.845655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:34.845655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:34.845655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:34.845655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:34.845958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:34.845958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:34.846107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:34.846107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:34.846107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:34.846107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:34.846413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:34.846413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:34.914831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:34.923540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:34.924971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:34.926144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9b65939d-df23-4601-9e98-8d4c89a7fee2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095224 Sep 01 07:33:34.926894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1045/2074] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:34.997739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:35.005784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a2cac195-dd25-4528-9921-7c1fff3a87a0 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172458 Sep 01 07:33:35.006342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1030/2075] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:34 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:35.851108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:35.851691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:35.852078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:35.852302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:35.858945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:35.859137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:35.859439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:35.859567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:35.859881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:35.860106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:35.860580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:35.860798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:35.861035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:35.861274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:35.861483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:35.861724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:36.049846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:36.052832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:36.058764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-425b368a-96fa-43d4-aa35-88da05b452ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210953 Sep 01 07:33:36.059334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1031/2076] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:36.061415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63bd2cb9-7cb2-40c0-bd76-daad27075892 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214881 Sep 01 07:33:36.062125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1046/2077] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:36.066280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:36.066951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:36.072988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:36.073487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:36.073912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:36.074564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:36.074720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:36.075014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:36.075207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:36.075424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:36.083047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:36.083525 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:36.083955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:36.084643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:36.085093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:36.085532 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:36.089462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:36.165850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:36.174288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:36.175712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:36.176843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f22d8568-f7c0-4dc1-a953-6e77a1bcc72d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.116581 Sep 01 07:33:36.177620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1032/2078] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:36.227007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:36.234986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e889c90c-6000-41cd-99a7-5a4c641bc632 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172106 Sep 01 07:33:36.235540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1047/2079] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:36 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:37.079923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:37.080524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:37.087143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:37.087612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:37.088048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:37.088048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:37.088232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:37.088711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:37.089183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:37.089604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:37.094696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:37.095180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:37.095612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:37.096294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:37.096740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:37.097179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:37.274036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:37.282327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba412473-3224-4c1e-8741-e4ff7bd9b260 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.206224 Sep 01 07:33:37.282854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1033/2080] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:37.284995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:37.287449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:37.288559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:37.294185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bc7c51d1-5e93-4967-a008-cbbd89a1021d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210338 Sep 01 07:33:37.294347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:37.294659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:37.295031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1048/2081] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:37.299357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:37.299947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:37.300083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:37.300693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:37.301201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:37.301644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:37.306314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:37.306790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:37.307220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:37.307901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:37.308340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:37.308754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:37.370277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:37.378917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:37.380371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:37.381561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34427bc0-bf7d-48a7-893b-a0a7bc33b9e5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097774 Sep 01 07:33:37.382182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1034/2082] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:37.451886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:37.459968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7dd0a340-4126-4da2-a2cb-3927a016d746 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.164086 Sep 01 07:33:37.460529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1049/2083] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:37 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:38.303141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:38.304369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:38.310806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:38.311294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:38.311744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:38.312433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:38.312892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:38.313380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:38.315399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:38.316005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:38.322851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:38.323331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:38.323764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:38.324448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:38.324896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:38.325362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:38.507664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:38.511417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:38.516514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-316cc6fd-9e9b-4349-801e-fa60283344e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217207 Sep 01 07:33:38.519827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1035/2084] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:38.519985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d349f43b-01bd-45d1-ab34-327092e3b0f0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208091 Sep 01 07:33:38.521404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1050/2085] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:38.523304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:38.523439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:38.527375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:38.528226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:38.529264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:38.529746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:38.530184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:38.530977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:38.531417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:38.531843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:38.536492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:38.537050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:38.537584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:38.538331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:38.538866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:38.539351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:38.600547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:38.608957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:38.610417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:38.611549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-497123d0-ba87-4467-b039-0f6bf07d53a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.093532 Sep 01 07:33:38.612101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1036/2086] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:38.685055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:38.693308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c46161c-8768-4071-9ae7-89e5edb42e22 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170770 Sep 01 07:33:38.693870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1051/2087] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:38 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:39.540714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:39.541376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:39.543341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:39.543946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:39.547773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:39.548254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:39.548687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:39.549399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:39.549850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:39.550266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:39.550389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:39.550740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:39.551166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:39.551841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:39.552286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:39.552700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:39.742089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:39.746297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:39.750409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-51d9d1ee-2365-4ec5-99ba-b48c47c04f95 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213544 Sep 01 07:33:39.750978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1037/2088] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:39.754570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c60850ec-5125-4737-b208-aaa4a1cfba90 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214952 Sep 01 07:33:39.760255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1052/2089] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:39.760255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:39.760611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:39.766907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:39.767391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:39.767824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:39.768490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:39.768593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:39.768984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:39.769102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:39.769446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:39.775499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:39.775963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:39.776394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:39.777075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:39.777552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:39.777970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:39.857690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:39.866734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:39.868207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:39.869372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c6a13fa-c3e3-4ab1-bb7b-cb89c606d82a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.109414 Sep 01 07:33:39.869924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1038/2090] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:39.922424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:39.931002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b9ed0ef-c119-4ba5-8346-4de6e6b5f194 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.174942 Sep 01 07:33:39.931567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1053/2091] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:39 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:40.771451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:40.772069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:40.776240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:40.776843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:40.778494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:40.778977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:40.779411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:40.780100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:40.780554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:40.780975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:40.783088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:40.783561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:40.783988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:40.784661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:40.785105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:40.785554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:40.970614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:40.974593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:40.983201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc199e6a-1810-4e30-84db-1eb7e6b45e58 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210677 Sep 01 07:33:40.983728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e8b917f9-4f27-4596-b60e-dc29237992b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216087 Sep 01 07:33:40.983897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1054/2092] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:40.984509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1039/2093] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:40.988102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:40.988650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:40.988770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:40.989299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:40.994879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:40.995359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:40.995791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:40.996048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:40.996471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:40.996602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:40.997204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:40.997344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:40.997623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:40.997976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:40.998430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:40.998859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:41.087618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:41.096387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:41.097870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:41.099004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79063c0c-92ad-41dc-a7da-7f977e78a4e3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.114354 Sep 01 07:33:41.099558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1055/2094] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:41.153394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:41.161503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a9a2652-4159-42bb-b89f-7e41ac3d48e7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.176260 Sep 01 07:33:41.162069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1040/2095] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:40 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:42.014536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:42.015429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:42.015820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:42.015930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:42.021867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:42.022020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:42.022891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:42.023026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:42.023312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:42.023447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:42.023997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:42.024116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:42.024451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:42.024582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:42.024871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:42.024992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:42.213030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:42.216743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:42.221304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e31856a-c44c-40d0-a7d0-a62dfb21c1cf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210516 Sep 01 07:33:42.221870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1056/2096] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:42.224816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8223814a-44db-43b6-9e76-00dbec6bd20e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214053 Sep 01 07:33:42.225595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1041/2097] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:42.226479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:42.227179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:42.229756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:42.230327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:42.232884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:42.233655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:42.234157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:42.234855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:42.235285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:42.235699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:42.235872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:42.236361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:42.237463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:42.238357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:42.238818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:42.239258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:42.318655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:42.327925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:42.329389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:42.330518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-edac408c-5dc6-48f2-8b4f-82a3034c45e8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.107754 Sep 01 07:33:42.331070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1057/2098] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:42.387541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:42.395951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-074bc471-24f6-4415-aa16-3884b3c67644 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.169607 Sep 01 07:33:42.396596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1042/2099] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:42 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:43.250842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:43.251421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:43.255071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:43.255716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:43.259039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:43.259524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:43.259954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:43.260681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:43.261265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:43.261577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:43.262606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:43.263098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:43.263541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:43.264233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:43.264948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:43.265407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:43.450593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:43.452794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:43.453979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:43.460509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3eb39b86-4126-42b2-b69e-87cdd685682f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212992 Sep 01 07:33:43.461083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1058/2100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:43.463011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10e92fbb-7c1b-49c8-ad76-f763b0060ceb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211691 Sep 01 07:33:43.473274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1043/2101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:43.473474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:43.473474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:43.473672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:43.473672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:43.473847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:43.473847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:43.473847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:43.473847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:43.474172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:43.474580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:43.474812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:43.475113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:43.475558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:43.476247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:43.476704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:43.477155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:43.545419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:43.554541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:43.555951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:43.557075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e09fe28c-3b93-4cf7-bec1-d7cc63002f03 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095073 Sep 01 07:33:43.557897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1059/2102] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:43.626205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:43.634919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3959fe0-38e4-4c85-8607-e4364a4663b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170130 Sep 01 07:33:43.635482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1044/2103] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:43 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:44.482563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:44.483780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:44.484024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:44.484643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:44.491088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:44.491290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:44.491711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:44.491847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:44.492152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:44.492261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:44.492847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:44.492951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:44.493334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:44.493508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:44.493759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:44.493898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:44.682546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:44.686581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:44.690896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74a39bc4-73ae-45c1-af54-ba79d95904f8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212282 Sep 01 07:33:44.691569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1060/2104] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:44.695447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2e44875-d8d6-4c77-b061-5863a37a6399 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215207 Sep 01 07:33:44.705142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1045/2105] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:44.705328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:44.705328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:44.705561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:44.705561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:44.705804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:44.705804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:44.705804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:44.705804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:44.706152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:44.706152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:44.707665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:44.708149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:44.709147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:44.709301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:44.710314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:44.710752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:44.787027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:44.795632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:44.797063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:44.798249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4fda8c48-3b7a-46bc-a3ad-820f619270b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.105783 Sep 01 07:33:44.798798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1061/2106] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:44.852495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:44.860556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-56ff6882-55b8-4fa0-abc1-3176ffde0950 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163644 Sep 01 07:33:44.861126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1046/2107] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:44 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:45.711885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:45.712486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:45.717926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:45.718538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:45.718921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:45.719397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:45.719822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:45.720494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:45.720936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:45.721383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:45.724501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:45.724989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:45.725457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:45.726146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:45.726605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:45.727529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:45.912767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:45.917641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:45.921575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97b4b592-6d71-4c25-a488-390f78791d57 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213528 Sep 01 07:33:45.922146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1062/2108] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:45.926042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f7332fe-c4c6-4942-91be-ead487f0bb7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211816 Sep 01 07:33:45.926513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:45.926870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1047/2109] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:45.931249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:45.931879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:45.936866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:45.937549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:45.938036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:45.938476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:45.939165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:45.939616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:45.940045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:45.943250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:45.944282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:45.944282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:45.944908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:45.945395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:45.945809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:46.027815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:46.036258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:46.037726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:46.038858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c7669b4-220e-457b-8629-9d447e3dbb41 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.115802 Sep 01 07:33:46.040276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1063/2110] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:46.091075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:46.093243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:46.100356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ff7a35c-a5b5-45f9-8f36-eed163ddec35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172525 Sep 01 07:33:46.100918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1048/2111] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:45 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:46.942929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:46.943525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:46.946438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:46.947087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:46.950062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:46.950539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:46.950964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:46.951639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:46.952082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:46.952494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:46.953630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:46.954104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:46.954536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:46.955396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:46.955846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:46.956265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:47.144537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:47.151630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:47.153608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6add527a-2f6f-4e1d-ad29-b38c23ce2d39 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214381 Sep 01 07:33:47.154285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1064/2112] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:47.158933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:47.159523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:47.159735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b185fbee-7197-45a6-9cec-72a9583c087f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217174 Sep 01 07:33:47.160556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1049/2113] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:47.165110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:47.165742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:47.171251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:47.171726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:47.172157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:47.172441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:47.172835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:47.172951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:47.173309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:47.173441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:47.173729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:47.174112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:47.174555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:47.175000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:47.258537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:47.269048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:47.270518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:47.271651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-962cfe87-2223-4e07-a9fc-2f6b9ed48f1e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.116395 Sep 01 07:33:47.272210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1065/2114] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:47.324135 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:47.332238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-34fd25cd-8759-4b86-932e-ffa674fdced9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171030 Sep 01 07:33:47.332806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1050/2115] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:47 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:48.174266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:48.174851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:48.181759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:48.182253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:48.182253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:48.182471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:48.182677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:48.183356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:48.183803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:48.184222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:48.188869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:48.189450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:48.189871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:48.190562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:48.191020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:48.191445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:48.368333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:48.374817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:48.376865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3e8d9335-eb82-4441-9b94-105f3ad98c46 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.199472 Sep 01 07:33:48.377474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1051/2116] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:48.382454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:48.383648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:48.383865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-340134df-5dc5-4197-b3c5-a1d43d7ade9d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212783 Sep 01 07:33:48.392633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1066/2117] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:48.392633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:48.392932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:48.393030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:48.393162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:48.393162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:48.393162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:48.393162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:48.393502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:48.397001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:48.397831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:48.398288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:48.398997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:48.399443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:48.399860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:48.476026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:48.485034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:48.486652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:48.487799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f8ae6080-26de-4629-a630-81d47e3f9f85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.109367 Sep 01 07:33:48.488381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1052/2118] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:48.541454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:48.549695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e81fc2ae-e588-4ae6-9c7f-7d72347f80d6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163956 Sep 01 07:33:48.550258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1067/2119] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:48 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:49.399386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:49.399930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:49.405499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:49.406100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:49.406304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:49.406783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:49.407213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:49.408002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:49.408452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:49.408908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:49.412414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:49.412892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:49.413348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:49.414033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:49.414476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:49.414928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:49.845036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:49.848251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:49.853277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a970f5c4-4a7d-4acb-bfb4-70684ec9ea36 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.451498 Sep 01 07:33:49.853935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1068/2120] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:49.856534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68e8cedd-35a8-479e-8c28-cb717ff314f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.461584 Sep 01 07:33:49.857301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1053/2121] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:49.858545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:49.859365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:49.865044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:49.865635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:49.866138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:49.866893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:49.867922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:49.868407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:49.872181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:49.872783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:49.878482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:49.878960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:49.879390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:49.880069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:49.880515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:49.880932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:49.931670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:49.940265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:49.941731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:49.942870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d26886dc-42b8-4e7c-b729-8412356dc479 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087960 Sep 01 07:33:49.943423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1069/2122] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:50.024892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:50.032994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-66f26911-a8d4-4ddc-81af-cf0057a6705f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.164328 Sep 01 07:33:50.033584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1054/2123] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:49 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:50.874809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:50.875457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:50.876636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:50.877280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:50.881897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:50.882380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:50.882814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:50.884006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:50.884129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:50.884449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:50.884579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:50.884868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:50.884976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:50.885595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:50.886039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:50.886455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:51.074480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:51.077967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:51.082782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-751ccef4-d9f4-4c82-b616-7c67f3f48e40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209890 Sep 01 07:33:51.083359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1055/2124] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:51.086335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b694f90-ee33-4def-8208-93887f693c6f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215377 Sep 01 07:33:51.097280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1070/2125] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:51.097456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:51.097456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:51.097651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:51.097651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:51.097878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:51.097878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:51.097878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:51.097878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:51.098263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:51.098263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:51.101409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:51.101989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:51.102492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:51.103250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:51.103765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:51.104277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:51.189435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:51.198569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:51.200050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:51.201212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2dfbffb4-9e41-493d-ab77-08580b0e07c7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.116837 Sep 01 07:33:51.201767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1056/2126] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:51.256009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:51.264992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17d293df-8415-4c35-ba05-5f5c00694fec tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.176938 Sep 01 07:33:51.265575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1071/2127] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:51 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:52.103985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:52.104600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:52.109007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:52.109657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:52.111044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:52.111527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:52.111961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:52.112653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:52.113108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:52.113553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:52.116063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:52.116546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:52.117019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:52.117769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:52.118240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:52.118661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:52.300674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:52.304830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:52.308901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-596d37a4-d295-4c16-96a3-8dc04d7bcd0e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.203632 Sep 01 07:33:52.309502 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1072/2128] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:52.313087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-73a0a113-8a39-4571-868c-016e7f908a2f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213482 Sep 01 07:33:52.325168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1057/2129] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:52.325364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:52.325364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:52.325564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:52.325564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:52.325750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:52.325750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:52.325750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:52.325750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:52.326076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:52.326076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:52.326273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:52.326273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:52.326273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:52.326531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:52.326934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:52.327353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:52.409904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:52.418368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:52.419799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:52.420932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-258e16c8-5994-4191-8381-2ebf16ffeebb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.110518 Sep 01 07:33:52.421534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1073/2130] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:52.483520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:52.491633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cfe17bfb-0bf5-457e-ac94-662734d663d2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.176988 Sep 01 07:33:52.492199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1058/2131] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:52 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:53.330813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:53.331412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:53.334645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:53.335267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:53.338486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:53.338991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:53.339422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:53.340099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:53.340541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:53.340955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:53.342198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:53.342680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:53.343117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:53.343802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:53.344251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:53.344676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:53.534670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:53.537942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:53.543474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a822f769-9eee-490d-8356-d84f0e1a140b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216471 Sep 01 07:33:53.544063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1074/2132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:53.546803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c13bc8a-4b47-4205-841d-37a73d558b0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216040 Sep 01 07:33:53.547596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1059/2133] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:53.551890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:53.552495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:53.558172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:53.558572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:53.558715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:53.559076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:53.559255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:53.559759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:53.560210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:53.560633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:53.565259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:53.565738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:53.566164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:53.566835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:53.567302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:53.567714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:53.582052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:53.646342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:53.655468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:53.656885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:53.658039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e64a610d-224c-44bb-b4e3-b197c23a7adf tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.113098 Sep 01 07:33:53.658800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1075/2134] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:53.710711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:53.719327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-133aba17-be7d-44f8-bf6f-4e70781ca9bb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170972 Sep 01 07:33:53.719885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1060/2135] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:53 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:54.565860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:54.566751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:54.569008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:54.569662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:54.574839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:54.575610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:54.576006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:54.576277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:54.576493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:54.576932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:54.577348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:54.577653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:54.577777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:54.578108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:54.578218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:54.578533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:54.767367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:54.770719 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:54.776046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-875bd34d-20b8-44ef-abc1-7c7650ba8bb2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210884 Sep 01 07:33:54.776717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1061/2136] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:54.779331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-53bfee56-5549-4ddf-b310-d42ebe6fffc9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218681 Sep 01 07:33:54.780049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1076/2137] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:54.784215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:54.784807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:54.790890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:54.791058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:54.791363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:54.791536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:54.791789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:54.792464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:54.792915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:54.793358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:54.800804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:54.801322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:54.801754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:54.802439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:54.802888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:54.803312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:54.877184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:54.885808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:54.887261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:54.889599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc637688-d3fc-47c7-8fcb-0b2fcc5dbe1f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.112074 Sep 01 07:33:54.890649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1062/2138] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:54.944153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:54.953571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b21182d9-d573-466b-8ed2-fafbdc447b80 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172699 Sep 01 07:33:54.954133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1077/2139] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:54 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:55.797079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:55.797728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:55.803478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:55.804087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:55.804227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:55.804572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:55.805578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:55.806286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:55.806733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:55.807153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:55.810946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:55.811426 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:55.811885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:55.812566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:55.813010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:55.813453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:56.000409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:56.004371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:56.008726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-61a777b2-cf23-4260-9311-d259c78488ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215517 Sep 01 07:33:56.009330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1063/2140] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:56.012417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1180e136-2536-4f11-8a73-b7e64d23f9d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212736 Sep 01 07:33:56.013143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1078/2141] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:56.013843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:56.014461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:56.017512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:56.021199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:56.021758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:56.022274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:56.023040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:56.023565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:56.023999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:56.030491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:56.031091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:56.036848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:56.037362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:56.037791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:56.038529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:56.038976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:56.039397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:56.088148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:56.096861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:56.098314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:56.099502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-df682ef4-a9c8-4416-a7d2-dfe93a9d4122 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089218 Sep 01 07:33:56.100067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1064/2142] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:56.182204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:56.191430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d211598e-0cfe-4ca9-a38a-8c142660285b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.164555 Sep 01 07:33:56.191988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1079/2143] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:56 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:57.030985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:57.031593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:57.033223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:57.033828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:57.037968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:57.038451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:57.038883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:57.040181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:57.040631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:57.040775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:57.041054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:57.041193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:57.041615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:57.042298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:57.042743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:57.043162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:57.055747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:33:57.238057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:57.246459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-084c2832-43d8-44cf-94b6-f06819905d26 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.219234 Sep 01 07:33:57.247034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1065/2144] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:57.248857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:57.251460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:57.252310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:57.257546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-afa7ff6d-90d9-4db1-b7f7-fb3ffbd6ba6c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.228030 Sep 01 07:33:57.257874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:57.258352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1080/2145] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:57.258500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:57.258794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:57.259485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:57.259940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:57.260364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:57.264212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:57.265352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:57.270918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:57.271403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:57.271838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:57.272520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:57.272975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:57.273431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:57.331920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:57.341195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:57.342638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:57.343776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3027d35-0cd8-474b-9cf6-50ebeb2c30fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095836 Sep 01 07:33:57.344330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1066/2146] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:57.414730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:57.422876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-460a2b58-c70b-483e-bdf0-bde7fd0ea5dc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.162707 Sep 01 07:33:57.423447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1081/2147] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:57 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:58.268188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:58.268794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:58.274841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:58.275327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:58.275766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:58.276455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:58.276952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:58.277410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:58.279010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:58.279802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:58.286338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:58.286814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:58.287243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:58.287923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:58.288367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:58.288783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:58.468303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:58.475208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:58.477426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8db2e071-b8ea-456d-9b12-72f094b8e456 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212911 Sep 01 07:33:58.478203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1067/2148] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:58.484209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-477384b0-fc4f-4607-a282-3ae4f4aadd0d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209259 Sep 01 07:33:58.484870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1082/2149] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:58.489663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:58.490287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:58.497839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:58.498412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:58.498879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:58.499222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:58.499986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:58.501145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:58.501617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:58.502048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:58.505419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:58.505900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:58.506342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:58.507047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:58.507686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:58.508152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:58.594507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:58.604432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:58.606019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:58.607035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5d1badb-c92c-4e32-8fca-91f46782497f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.116796 Sep 01 07:33:58.607595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1068/2150] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:58.656923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:58.665628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19726f4d-300e-44ce-b565-bf3d9c382534 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.179780 Sep 01 07:33:58.666185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1083/2151] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:58 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:59.502677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:59.503292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:59.505762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:59.506363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:59.509726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:59.510212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:59.510647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:59.511338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:59.511791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:59.512183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:59.512303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:59.512652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:59.513077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:59.513773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:59.514211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:59.514624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:59.703065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:59.706345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:59.711797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54be2e42-af65-42d4-bcdc-8f8dc11995cb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212433 Sep 01 07:33:59.712375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1069/2152] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:33:59.715328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1139463e-d6e6-40ab-b0b6-f6ddc0d0f3a5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213423 Sep 01 07:33:59.715880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1084/2153] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:33:59.716864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:59.717780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:59.720469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:33:59.721291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:33:59.723634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:59.724290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:59.724896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:59.725902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:59.726529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:59.726953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:59.727281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:59.727887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:59.728312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:59.728999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:33:59.729443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:33:59.729852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:33:59.808680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:59.817182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:59.818621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:59.819755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c553979-d07b-4f4b-9f01-274bd41a2b2e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.106480 Sep 01 07:33:59.820315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1070/2154] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:33:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:33:59.873606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:33:59.881730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d7b3099-678d-4bca-9242-128724df15d7 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.164737 Sep 01 07:33:59.882294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1085/2155] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:33:59 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:00.732912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:00.733541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:00.735865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:00.736961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:00.738987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:00.739924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:00.740484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:00.740987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:00.741731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:00.742270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:00.743172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:00.744598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:00.745074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:00.745618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:00.746289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:00.746757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:00.747293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:00.936155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:00.939407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:00.944276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9d2e999-77d5-4389-8242-e35935b39455 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215414 Sep 01 07:34:00.944970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1071/2156] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:00.949101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c0061084-0581-47ee-9dd4-1b3613d6e8c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216964 Sep 01 07:34:00.962556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1086/2157] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:00.962740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:00.962740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:00.962947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:00.962947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:00.963116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:00.963116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:00.963116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:00.963116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:00.963448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:00.963448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:00.963611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:00.963611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:00.963611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:00.963611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:00.963933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:00.963933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:01.044088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:01.052610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:01.054079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:01.055742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e425363b-d6a6-44d0-b58f-1fcbd8c6c584 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.109312 Sep 01 07:34:01.056299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1072/2158] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:01.109730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:01.118555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02baa853-30ff-42c8-be2b-45f097afa353 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.167947 Sep 01 07:34:01.119107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1087/2159] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:00 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:01.965579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:01.966185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:01.969782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:01.970388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:01.972598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:01.973081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:01.973543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:01.974223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:01.974676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:01.975098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:01.976636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:01.977657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:01.978263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:01.978945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:01.979387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:01.979806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:02.164363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:02.171138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:02.172587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-114f1d53-f441-4fe1-a997-cd7357b91d16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210809 Sep 01 07:34:02.173179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1073/2160] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:02.177598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:02.178332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:02.179958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e558c4dd-0990-478f-abce-88b4d86afa7f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213779 Sep 01 07:34:02.180691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1088/2161] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:02.184099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:02.184595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:02.185033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:02.185606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:02.185796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:02.186212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:02.186332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:02.186640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:02.191977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:02.192455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:02.192916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:02.193625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:02.194071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:02.194497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:02.256166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:02.265561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:02.266996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:02.268129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fa86a184-73bb-43c9-8374-9e24bfb10aa3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.094044 Sep 01 07:34:02.268878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1074/2162] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:02.340085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:02.348284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2669aaa8-ab7e-4075-9a01-a9e6f787c6cc tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166671 Sep 01 07:34:02.348845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1089/2163] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:02 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:03.202899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:03.203604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:03.210079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:03.210576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:03.211015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:03.212209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:03.212664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:03.213090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:03.213508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:03.214145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:03.220467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:03.220932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:03.221386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:03.222055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:03.222493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:03.222902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:03.400691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:03.404612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:03.408925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0fd9492-cae3-4a95-a14a-44d5a04d86db tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209934 Sep 01 07:34:03.409520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1075/2164] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:03.413141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52d9c3fb-c2c6-4582-8920-648e9f84c96e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.204245 Sep 01 07:34:03.413937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1090/2165] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:03.414093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:03.414573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:03.418300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:03.418970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:03.420240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:03.420735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:03.421198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:03.421887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:03.422339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:03.422762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:03.425150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:03.425700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:03.426203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:03.426952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:03.427465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:03.427957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:03.495303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:03.503720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:03.505192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:03.506459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4231763c-8bc4-4936-97fa-e54bcd16a388 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095904 Sep 01 07:34:03.507218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1076/2166] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:03.576093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:03.584120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4438de4-aff3-4b70-bb05-662e1434972b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.169427 Sep 01 07:34:03.584682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1091/2167] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:03 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:04.441489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:04.442024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:04.443428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:04.444031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:04.448751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:04.449283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:04.449730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:04.450365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:04.450494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:04.450865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:04.450995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:04.451293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:04.451415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:04.451961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:04.452399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:04.452811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:04.456625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:04.646799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:04.654047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:04.655592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1c627b47-16f6-4b35-8716-f554178eb290 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218581 Sep 01 07:34:04.656161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1077/2168] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:04.660509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:04.661140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:04.667204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:04.667376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fbf816b4-4306-4a9c-83f8-be83a8f4a814 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.227554 Sep 01 07:34:04.667696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:04.668220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1092/2169] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:04 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:04.668372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:04.668818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:04.669384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:04.669740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:04.672862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:04.673848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:04.679261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:04.679818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:04.680351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:04.681109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:04.681684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:04.682169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:04.733223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:04.742016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:04.743474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:04.744627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b1d688c2-ba4d-414a-9d70-0d7093000a48 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087549 Sep 01 07:34:04.745208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1078/2170] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:04.827382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:04.835440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cf93472-73e6-44f1-a99f-9640afd75968 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166428 Sep 01 07:34:04.836003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1093/2171] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:04 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:05.687840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:05.688457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:05.689475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:05.690079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:05.695016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:05.696012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:05.696447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:05.696918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:05.697157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:05.697417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:05.697624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:05.697842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:05.698052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:05.698507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:05.698943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:05.699352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:05.835703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:05.845109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5685ebc9-014f-4d6a-9e37-14a61e972650 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.160995 Sep 01 07:34:05.845724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1079/2172] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:05.852253 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:05.852878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:05.866119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:05.866630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:05.867095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:05.871478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:05.871954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:05.873730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:05.950562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:05.959111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:05.960555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:05.962332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d8602d35-b3ce-45ee-9627-3f95ade33b4f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.115685 Sep 01 07:34:05.962893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1080/2173] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:05.967169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:05.967776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:05.973418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:05.973904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:05.974341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:05.975024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:05.975479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:05.975904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:06.007477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:06.016566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3fc5797b-f68a-463f-b6aa-05bd75deccac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.330943 Sep 01 07:34:06.017247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1094/2174] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:06.099573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:06.107673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08c1efca-0274-4496-baf3-47a1ffc69726 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.143828 Sep 01 07:34:06.108212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1081/2175] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:05 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:06.865992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:06.866591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:06.873068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:06.873567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:06.873986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:06.874649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:06.875087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:06.875499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:06.985194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:06.985194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:06.991409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:06.991895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:06.992348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:06.993026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:06.993518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:06.993950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:06.997963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:07.010189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:07.018543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27a26b7d-6bf0-4050-8f56-1003aa6c0b30 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.156314 Sep 01 07:34:07.019031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1095/2176] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:07.037182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:07.037819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:07.044220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:07.044729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:07.045193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:07.045907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:07.046355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:07.046777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:07.055614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:07.064143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:07.065644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:07.066798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-506697c5-6369-421b-973f-2f75dd45c6ab tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086307 Sep 01 07:34:07.067364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1082/2177] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:34:07.128719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:07.129403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:07.136081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:07.136570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:07.137009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:07.137730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:07.138187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:07.138619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:07.171571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:07.179759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5dd23771-1403-4e4f-9722-8f40933086ef tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.146312 Sep 01 07:34:07.180318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1096/2178] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:07.270460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:07.279057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-62031d0b-82e8-42a2-a486-0451df465e0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.154157 Sep 01 07:34:07.279614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1083/2179] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:07 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:08.040528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:08.041144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:08.047529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:08.048002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:08.048429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:08.049100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:08.049565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:08.049977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:08.088492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:08.089106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:08.095625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:08.096110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:08.096547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:08.097273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:08.097725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:08.098143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:08.168638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:08.177227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:08.178668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:08.179806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55811084-4182-42cb-aeeb-1ab27cbe72b0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095107 Sep 01 07:34:08.180930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1084/2180] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:34:08.198324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:08.200961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:08.201611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:08.206569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-092a4726-ec22-4330-99b3-d42feaed27b4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.170283 Sep 01 07:34:08.207154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1097/2181] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:08.207516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:08.207987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:08.208424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:08.209142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:08.209590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:08.210012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:08.299749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:08.300258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:08.306176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:08.306653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:08.307085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:08.307766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:08.308209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:08.308638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:08.340763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:08.349343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3177a9b9-4f9a-480d-b841-bcb35996b349 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.152065 Sep 01 07:34:08.350008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1085/2182] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:08.435280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:08.443364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1044c988-c235-495b-b86f-afbf84e89199 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147539 Sep 01 07:34:08.443918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1098/2183] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:08 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:09.202577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:09.203223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:09.209721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:09.210266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:09.210704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:09.211436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:09.212141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:09.212884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:09.227272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:09.227900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:09.234454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:09.235441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:09.235441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:09.236043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:09.236490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:09.236909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:09.284056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:09.293063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:09.294553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:09.295743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e1c9945-6b9f-4862-8883-48159dfbf11a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097036 Sep 01 07:34:09.296307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1086/2184] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:09 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:09.371877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:09.372487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:09.378321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:09.378805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:09.379238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:09.379924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:09.380188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:09.380372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:09.380793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:09.388337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1828459a-5652-4a00-a681-b2cd6f8bc1d8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.164887 Sep 01 07:34:09.388895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1099/2185] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:09.463118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:09.463724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:09.469654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:09.470132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:09.470564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:09.471252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:09.471694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:09.472111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:09.507947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:09.516392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-138358e3-95e5-47d1-947e-380e87e0e3c1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.148979 Sep 01 07:34:09.516967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1087/2186] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:09.604730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:09.612905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-30c05244-4cc4-49d1-ae81-4572b5cea7ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.153623 Sep 01 07:34:09.613495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1100/2187] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:09 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:10.318347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:10.318949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:10.325770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:10.326636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:10.327070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:10.327748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:10.328194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:10.328612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:10.390046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:10.398589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:10.400676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:10.401845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6223aba6-ddc8-400a-ac87-a8f0e5ea39ac tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087403 Sep 01 07:34:10.402531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1088/2188] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:10.409757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:10.410356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:10.416703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:10.417206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:10.417637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:10.418306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:10.418746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:10.419158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:10.537326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:10.537957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:10.544758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:10.548506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:10.548979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:10.549739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:10.549996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:10.550198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:10.550627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:10.559111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42287efc-d936-4f5e-a0c1-244cd539f23d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.153081 Sep 01 07:34:10.559816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1101/2189] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:10.634579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:10.635178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:10.641260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:10.641732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:10.642155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:10.642828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:10.643266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:10.643679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:10.690266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:10.699100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-02250188-c002-4d50-b6fa-b516d15afce3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.165696 Sep 01 07:34:10.699660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1089/2190] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:10.771510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:10.779566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-81086cd9-ada6-426b-ac01-4330d77425bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149353 Sep 01 07:34:10.780132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1102/2191] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:10 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:11.423984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:11.424583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:11.431062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:11.431549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:11.431991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:11.432686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:11.433159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:11.433593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:11.494107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:11.502647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:11.504094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:11.505267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ced4836-400b-4661-9ac5-2a7e054a745a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085126 Sep 01 07:34:11.505834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1090/2192] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:11.580273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:11.580865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:11.587655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:11.588109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:11.588531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:11.589240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:11.589678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:11.590091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:11.716969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:11.725990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4137e47-e3cd-4f6e-a3f2-43ab11a5e221 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.149408 Sep 01 07:34:11.726559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1103/2193] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:11.799830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:11.800459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:11.806194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:11.806662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:11.807089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:11.807756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:11.808194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:11.808604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:11.822763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:11.823374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:11.829306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:11.829850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:11.830294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:11.830978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:11.831499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:11.831928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:12.009092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:12.012348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:12.017758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-970cd531-a3ef-46b2-a06f-5034b278ac21 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.221620 Sep 01 07:34:12.018454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1104/2194] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:11 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:12.020588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bcd571e3-e5a8-49d9-b229-89a66b9a90cd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.304559 Sep 01 07:34:12.021169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1091/2195] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:12.527701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:12.528291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:12.534398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:12.534875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:12.535301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:12.535971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:12.536411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:12.536822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:12.597026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:12.606195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:12.607630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:12.608849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55905f47-6629-4db3-844b-d7937b73e58f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085043 Sep 01 07:34:12.609431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1105/2196] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:12.747540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:12.748156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:12.754637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:12.755128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:12.755567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:12.756258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:12.756713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:12.757164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:12.880899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:12.888996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-146b65ae-d7e9-4a2d-8cee-33dad87cfa3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.145271 Sep 01 07:34:12.889591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1092/2197] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:13.038957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:13.040119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:13.042078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:13.042735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:13.046065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:13.046541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:13.046977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:13.047650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:13.048092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:13.048504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:13.048620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:13.049053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:13.049547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:13.050221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:13.050681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:13.051110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:13.232383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:13.241986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd1f05f5-3fd9-4681-b010-1c93d0fa5aee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.206492 Sep 01 07:34:13.242562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1106/2198] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:13 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:13.247751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:13.255997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a3b64d6-49a8-425d-a789-78ba825b1d8b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218301 Sep 01 07:34:13.256560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1093/2199] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:13.705581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:13.706182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:13.712013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:13.712484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:13.712910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:13.713605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:13.714042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:13.714453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:13.775264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:13.783672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:13.785153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:13.786285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3bebaa88-074b-4547-a0aa-63dc7a8fa28d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.158964 Sep 01 07:34:13.786837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1107/2200] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:13.909585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:13.910126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:13.917222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:13.917703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:13.918140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:13.918851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:13.919301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:13.919722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:14.048241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:14.056995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7febe4c5-2c37-46cc-b705-6eaeb05251eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.151346 Sep 01 07:34:14.057587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1094/2201] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:14.262468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:14.262982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:14.269086 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:14.269587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:14.270012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:14.270682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:14.271136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:14.271534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:14.278038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:14.278677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:14.284442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:14.284917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:14.285397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:14.286086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:14.286545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:14.286976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:14.464609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:14.466842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:14.468702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:14.474140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88d2e884-3d82-4c61-ab9e-de0290082c13 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.215584 Sep 01 07:34:14.474733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1108/2202] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:14 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:14.476828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f441ae94-208c-417a-8572-9d3aad882db4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.203084 Sep 01 07:34:14.478115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1095/2203] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:14.808761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:14.809398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:14.815772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:14.816243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:14.816670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:14.817368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:14.817807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:14.818224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:14.879300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:14.888159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:14.889612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:14.890989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf8e73d5-42e7-47db-94f4-793c7c6747ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086360 Sep 01 07:34:14.891535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1109/2204] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:15.077909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:15.078527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:15.084851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:15.085368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:15.085809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:15.086540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:15.086992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:15.087418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:15.211425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:15.224827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d13b433d-d0fb-467e-8c35-3e929bfeb885 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.150697 Sep 01 07:34:15.225599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1096/2205] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:15.496568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:15.497108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:15.497629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:15.498243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:15.503116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:15.503592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:15.504020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:15.504138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:15.504600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:15.504731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:15.505041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:15.505182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:15.505553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:15.505753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:15.506208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:15.506631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:15.693329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:15.701392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-854eb7a5-9f5b-46d8-babe-cd11636967ef tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.209339 Sep 01 07:34:15.701959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1110/2206] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:15 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:15.704275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:15.712508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-93bafa51-be49-4c3c-91a3-8a61e6598605 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218613 Sep 01 07:34:15.713060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1097/2207] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:15.913644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:15.914242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:15.920484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:15.920947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:15.921400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:15.922066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:15.922504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:15.922913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:15.983444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:15.991918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:15.994017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:15.995159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84d7a2c6-f495-4557-ad11-160ad49ecea9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085458 Sep 01 07:34:15.995727 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1111/2208] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:16.246405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:16.247023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:16.253601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:16.254092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:16.254538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:16.255227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:16.255683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:16.256109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:16.387249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:16.389475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:16.396961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50d1e02c-9339-4cca-b2a9-c5db4f24e1a6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.155449 Sep 01 07:34:16.397557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1098/2209] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:16.722373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:16.722980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:16.729595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:16.730081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:16.730518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:16.731202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:16.731651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:16.732075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:16.733958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:16.734565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:16.740270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:16.740745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:16.741215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:16.741897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:16.742344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:16.742764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:16.921410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:16.925439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:16.929723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac13aa61-88dc-4144-8a74-8b6bae32c4e6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.211152 Sep 01 07:34:16.930293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1112/2210] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:16 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:16.933515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3bab882c-9563-4877-82fc-0e3f1232a45e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.203559 Sep 01 07:34:16.934064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1099/2211] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:17.017843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:17.018451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:17.025135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:17.025607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:17.026035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:17.026709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:17.027150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:17.027564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:17.087437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:17.095694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:17.097142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:17.098271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c3f6cca-0d54-4da8-b419-7ea9d65a7959 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084520 Sep 01 07:34:17.098815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1113/2212] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:17.417566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:17.418185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:17.424538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:17.425028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:17.425500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:17.426190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:17.426646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:17.427074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:17.552496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:17.561060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1c0c200c-7953-40f4-9588-bff3b48232b9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.147329 Sep 01 07:34:17.561777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1100/2213] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:17.950505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:17.951102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:17.954611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:17.954820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:17.957540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:17.958007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:17.958434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:17.959107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:17.959547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:17.959961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:17.960745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:17.961266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:17.961738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:17.962438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:17.962893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:17.963323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:18.150263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:18.153343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:18.158508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5bd0788-2572-42ca-b310-7f88f5ba9bd8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208071 Sep 01 07:34:18.159208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1101/2214] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:18.161633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6808218-db2b-4673-a86e-15894edc9339 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.214986 Sep 01 07:34:18.172706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1114/2215] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:17 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:18.172889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:18.172889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:18.172889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:18.172889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:18.173332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:18.173332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:18.173332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:18.173624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:18.237464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:18.246000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:18.247842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:18.248993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-712784ba-43d1-4f55-8e85-9368a9d5c90d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088866 Sep 01 07:34:18.249589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1102/2216] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:18.582663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:18.583299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:18.589932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:18.590410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:18.590843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:18.591519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:18.591966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:18.592383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:18.716359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:18.724416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f7c906b-33ca-410a-b80c-41579b9f3eff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.145613 Sep 01 07:34:18.724966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1115/2217] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:19.180249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:19.180861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:19.182772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:19.183379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:19.187266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:19.187747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:19.188222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:19.188891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:19.189367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:19.189681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:19.189794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:19.190153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:19.190577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:19.191252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:19.191722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:19.192138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:19.383715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:19.386576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:19.392783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-41bd373e-da83-4627-995f-9fa0d0ff8844 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216558 Sep 01 07:34:19.393513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1103/2218] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:19.395017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7693718b-14cf-4171-98be-9108910e066b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.216062 Sep 01 07:34:19.400183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1116/2219] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:19 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:19.400353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:19.400353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:19.405647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:19.406125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:19.406556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:19.407242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:19.407688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:19.408105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:19.468607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:19.477519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:19.478956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:19.480089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1e746a56-707f-4312-a92f-013a85ac7ea0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085542 Sep 01 07:34:19.480639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1104/2220] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:19.745739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:19.746252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:19.752428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:19.752918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:19.753475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:19.754177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:19.754626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:19.755046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:19.889745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:19.898253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-416ef208-2a44-43f8-a01d-7857dfece559 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.156977 Sep 01 07:34:19.898819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1117/2221] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:20.415241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:20.415835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:20.416224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:20.416826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:20.422220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:20.422706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:20.423055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:20.423181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:20.423523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:20.423820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:20.423929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:20.424280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:20.424602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:20.424731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:20.425042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:20.425477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:20.618186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:20.622429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:20.626304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-670495b9-184f-4d14-b1ba-984e42eb5525 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215505 Sep 01 07:34:20.626875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1105/2222] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:20.630758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd604039-95f7-4ad8-b58e-7ae537563207 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.218886 Sep 01 07:34:20.631463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:20.631588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1118/2223] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:20 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:20.632024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:20.638170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:20.638652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:20.639088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:20.639784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:20.640482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:20.640903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:20.919639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:20.920236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:20.926172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:20.926644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:20.927072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:20.927752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:20.928191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:20.928602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:20.955410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:20.964039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:20.965515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:20.966658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e049a10c-3a7f-436c-aeec-3dfb7f657322 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.338876 Sep 01 07:34:20.967210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1106/2224] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:21.054115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:21.062054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47e867e5-601b-412c-9869-cbb674d820bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.146291 Sep 01 07:34:21.062607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1119/2225] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:21.648381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:21.649789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:21.652409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:21.653012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:21.656066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:21.656554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:21.656991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:21.657711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:21.658244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:21.658623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:21.659902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:21.660378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:21.660805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:21.661531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:21.661969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:21.662382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:21.848574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:21.852010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:21.856736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-163f729a-365b-4463-83a4-b816546923d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.208731 Sep 01 07:34:21.857323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1120/2226] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:21 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:21.860718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-16ac60ba-3c8a-497d-bf84-8e0ced8976d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216101 Sep 01 07:34:21.861315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1107/2227] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:21.988587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:21.989148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:21.995493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:21.995962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:21.996382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:21.997046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:21.997510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:21.997923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:22.057652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:22.065938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:22.067369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:22.068482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d16fd54-6cd5-475a-92ed-0a56aaf31e60 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.083847 Sep 01 07:34:22.069031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1121/2228] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:34:22.082556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:22.083168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:22.088955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:22.089490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:22.089911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:22.090596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:22.091049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:22.091476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:22.217575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:22.225793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-05181037-d816-439b-886e-448d61a4a526 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.147017 Sep 01 07:34:22.226353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1108/2229] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:22.878285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:22.878890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:22.883483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:22.884095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:22.885828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:22.886297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:22.886723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:22.887403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:22.887840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:22.888251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:22.890806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:22.891316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:22.891787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:22.892478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:22.892930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:22.893388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:23.074109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:23.082140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33520119-1b4b-4362-a795-494aa90d5bf2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.208711 Sep 01 07:34:23.082718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1122/2230] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:22 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:23.084663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:23.090659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:23.091258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:23.093793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e576ed7c-6f0e-426b-b533-d7800b818f83 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214583 Sep 01 07:34:23.094527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1109/2231] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:23.097055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:23.097557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:23.097998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:23.098679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:23.099124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:23.099541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:23.159329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:23.167710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:23.169168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:23.170303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ec580a8-8956-4eef-bc8b-aaacec68662f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.083848 Sep 01 07:34:23.170862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1123/2232] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:34:23.247740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:23.248361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:23.254270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:23.254761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:23.255199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:23.255888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:23.256340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:23.256768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:23.390905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:23.399076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54363f7b-5f07-4895-accc-c4a57a3b5402 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.155631 Sep 01 07:34:23.399655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1110/2233] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:24.104206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:24.104819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:24.111731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:24.112222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:24.112658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:24.113374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:24.113826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:24.114282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:24.114517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:24.115159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:24.121369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:24.121848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:24.122281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:24.122955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:24.123402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:24.123819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:24.308590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:24.311723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:24.317065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f5803a7-833c-4bd7-98b2-0e2fcdc263ee tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.217235 Sep 01 07:34:24.317734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1124/2234] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:24 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:24.319769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-52fafaaa-4e35-491c-a842-da0f20df874b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208952 Sep 01 07:34:24.320468 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1111/2235] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:24.322539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:24.323130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:24.328697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:24.329191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:24.329618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:24.330288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:24.330731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:24.331141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:24.346058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:24.392833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:24.401973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:24.403422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:24.404557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63404a75-f2b4-4074-9e54-c8f7a9f5a714 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085912 Sep 01 07:34:24.405092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1125/2236] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:24.419645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:24.420254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:24.426046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:24.426527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:24.426958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:24.427630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:24.428077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:24.428496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:24.556661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:24.564747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd62e7ca-a80f-46f4-8f8c-95dd471b87bf tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.148906 Sep 01 07:34:24.565341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1112/2237] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:24 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:25.338849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:25.339952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:25.340876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:25.341518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:25.347259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:25.347732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:25.347869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:25.348158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:25.348332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:25.348766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:25.348887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:25.349292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:25.349481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:25.349704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:25.349934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:25.350367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:25.535720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:25.544317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ceb5d49-3ec8-4ad4-8bcb-24fbe7aacacb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.209934 Sep 01 07:34:25.544881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1126/2238] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:25 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:25.549362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:25.549953 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:25.551564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:25.555601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:25.556071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:25.556496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:25.557220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:25.557657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:25.558069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:25.560611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fff3d99f-10de-46c3-b24d-63d89e39a7fe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.224867 Sep 01 07:34:25.561493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1113/2239] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:25.586550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:25.587178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:25.589078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:25.594999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:25.595495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:25.595940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:25.596636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:25.597090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:25.597545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:25.618879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:25.627336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:25.628785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:25.629933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55a1a96e-5025-4b2b-8c5e-eaf9258dc8cb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084123 Sep 01 07:34:25.630484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1127/2240] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:25.731155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:25.739227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67ec9ed3-4a78-4b3d-be7e-dbfe0c06e794 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.156845 Sep 01 07:34:25.739792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1114/2241] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:26.565557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:26.566158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:26.573037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:26.573540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:26.573971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:26.574636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:26.575073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:26.575562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:26.581585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:26.582194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:26.588620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:26.589106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:26.589571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:26.590260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:26.590713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:26.591140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:26.607925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:26.716511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:26.725111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a365de0f-cb53-4482-9958-3dfa4561ac00 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163340 Sep 01 07:34:26.725715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1128/2242] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:26 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:26.730950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:26.731548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:26.737836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:26.738315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:26.738739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:26.739421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:26.739857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:26.740267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:26.809654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:26.818158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:26.819601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:26.820777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f22d586d-90e4-4c3f-bb65-7ce5876e1e17 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.094139 Sep 01 07:34:26.826343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1129/2243] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:26.829655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:26.830264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:26.836503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:26.837257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:26.837688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:26.838377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:26.838827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:26.839247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:26.924448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:26.933493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d62e7fde-1e8f-4529-b314-ebf707eb5bb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.355681 Sep 01 07:34:26.934239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1115/2244] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:26.983809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:26.991942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c17849e-f1d9-4770-9084-b34c1a841aa9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.169602 Sep 01 07:34:26.993140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1130/2245] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:27.747082 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:27.747669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:27.754029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:27.754504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:27.754943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:27.755622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:27.756069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:27.756486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:27.843581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:27.844406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:27.851064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:27.851619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:27.852140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:27.852812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:27.853288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:27.853708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:27.886136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:27.894665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85ccd335-d39c-434e-915f-97f779bdd3da tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151367 Sep 01 07:34:27.895231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1116/2246] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:27 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:27.917574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:27.926145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:27.927585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:27.928715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-993e3429-c6b7-413c-b19d-ff2425befbe0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089144 Sep 01 07:34:27.929429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1131/2247] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:34:27.954121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:27.954721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:27.960728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:27.961369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:27.961807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:27.962516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:27.962963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:27.963381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:28.012981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:28.013529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:28.019698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:28.020180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:28.021543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:28.022255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:28.022708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:28.023130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:28.129161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:28.138272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54be6c59-4480-4578-8d8d-e86912eba4fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.187873 Sep 01 07:34:28.142953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1117/2248] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:28.175886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:28.185872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8dc61836-97f3-4671-ba3f-d853452a9d0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.176805 Sep 01 07:34:28.186442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1132/2249] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:28.915347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:28.915890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:28.924881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:28.925800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:28.926435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:28.927142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:28.927600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:28.928029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:28.951942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:28.952541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:28.959135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:28.959610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:28.960044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:28.960722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:28.961185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:28.962203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:29.037678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:29.046128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:29.047675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:29.048807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e68fec0c-08a6-44e8-9305-24b23bda02cd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.100732 Sep 01 07:34:29.049577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1133/2250] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:34:29.078038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:29.086140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7093ecf6-6dbf-483d-a42e-34189eed39c6 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.174870 Sep 01 07:34:29.087340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1118/2251] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:28 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:29.159697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:29.160300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:29.166380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:29.166804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:29.167234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:29.167906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:29.168350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:29.168767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:29.206605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:29.207034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:29.213494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:29.213983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:29.214423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:29.215118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:29.215570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:29.215993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:29.346457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:29.354676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02818f8e-ee94-4160-9f1c-fb1c58b86eb3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.198815 Sep 01 07:34:29.355237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1134/2252] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:29.372077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:29.380114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e0f1608e-0400-4de4-b7e0-16352d720358 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.177510 Sep 01 07:34:29.380661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1119/2253] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:30.071276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:30.071885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:30.078226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:30.078704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:30.079135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:30.079814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:30.080259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:30.080685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:30.106984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:30.107593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:30.114148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:30.114630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:30.115067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:30.115772 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:30.116224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:30.116643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:30.143418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:30.152075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:30.153657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:30.154872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e42ce7fa-e656-4f2b-bb2f-368b3f41e1a5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088115 Sep 01 07:34:30.155514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1135/2254] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:30.244988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:30.253235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d59ae3b4-b0a8-4814-9eab-81646703f004 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150050 Sep 01 07:34:30.253799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1120/2255] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:30 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:30.375678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:30.376284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:30.378135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:30.383307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:30.383793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:30.384244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:30.384902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:30.385384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:30.385803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:30.401482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:30.402093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:30.410331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:30.410819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:30.411251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:30.411945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:30.412395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:30.412814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:30.584493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:30.591131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:30.592782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d04c7f74-1038-46dc-ab1a-379e1d69a2c9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220865 Sep 01 07:34:30.593389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1136/2256] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:30.599306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0fede0f1-631a-4997-9ea0-280ceb39c3c7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.201662 Sep 01 07:34:30.599849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1121/2257] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:31.178617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:31.179224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:31.186137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:31.186616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:31.187051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:31.187725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:31.188174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:31.188593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:31.250706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:31.259266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:31.260747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:31.261919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19fbc96e-fc30-42a3-abf4-6f1e59f268a4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087240 Sep 01 07:34:31.262484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1137/2258] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:31.274766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:31.275465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:31.281890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:31.282369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:31.282808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:31.283497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:31.283945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:31.284368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:31.412534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:31.421284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f967ddbe-50a5-424e-b66e-797c8f326987 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150251 Sep 01 07:34:31.421849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1122/2259] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:31 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:31.614314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:31.614935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:31.619553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:31.620165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:31.620778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:31.621288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:31.621725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:31.622395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:31.622836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:31.623247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:31.625928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:31.626411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:31.626851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:31.627538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:31.627989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:31.628444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:31.811634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:31.818505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:31.819842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34c2e188-5dd8-4c00-980f-f91cf3f2e0e6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209329 Sep 01 07:34:31.820411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1138/2260] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:31.827133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2ac5234-1209-4cdf-90c1-17ad08a94604 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211307 Sep 01 07:34:31.827692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1123/2261] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:32.283965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:32.284594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:32.291031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:32.291504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:32.291931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:32.292600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:32.293042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:32.293485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:32.354242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:32.362669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:32.364106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:32.365260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-588743e6-5d94-4f32-97c9-6a67146a56b1 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085186 Sep 01 07:34:32.365819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1139/2262] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:32.442739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:32.443352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:32.450394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:32.450880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:32.451322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:32.452010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:32.452469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:32.452896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:32.579196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:32.587163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-44198f80-9cc2-4323-9039-4b04acaf53de tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148323 Sep 01 07:34:32.587796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1124/2263] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:32 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:32.842094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:32.842673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:32.847994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:32.848536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:32.848678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:32.849008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:32.849478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:32.850174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:32.850613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:32.851025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:32.854909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:32.855398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:32.855831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:32.856518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:32.856972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:32.857422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:33.041536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:33.048169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:33.049755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ce29275-99cb-4f2f-9501-12ec2b8cd4c5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211485 Sep 01 07:34:33.050338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1140/2264] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:33.056796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b6803bc0-2d67-4b2a-8ce4-b089dc5587fa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212626 Sep 01 07:34:33.057394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1125/2265] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:33.388228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:33.388822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:33.395493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:33.395964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:33.396390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:33.397062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:33.397527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:33.397940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:33.458124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:33.467149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:33.468574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:33.469730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f32199fa-df41-47be-965d-05ec2704e29a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085978 Sep 01 07:34:33.470279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1141/2266] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:33.607820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:33.608457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:33.614764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:33.615245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:33.615686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:33.616370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:33.616820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:33.617274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:33.741921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:33.750539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0f0d91cb-19dd-477f-82fd-e1bf9a7ff593 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.146605 Sep 01 07:34:33.751097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1126/2267] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:33 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:34.072032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:34.073670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:34.078088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:34.078699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:34.080696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:34.081215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:34.081657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:34.082343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:34.082789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:34.083209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:34.084417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:34.084896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:34.085363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:34.086042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:34.086490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:34.086912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:34.087093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:34.274315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:34.281217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:34.282460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34eff90b-4ba2-445b-8225-a315678d55ec tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215251 Sep 01 07:34:34.283224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1142/2268] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:34.289453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-37b023fa-2308-4695-87ce-6d254f01dd9d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215228 Sep 01 07:34:34.290003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1127/2269] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:34.492039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:34.492681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:34.499701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:34.500174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:34.500613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:34.501319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:34.501795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:34.502213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:34.563884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:34.572303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:34.573786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:34.574923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2e30382-972c-4ddb-b818-2dbe1ec25f84 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087041 Sep 01 07:34:34.575468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1143/2270] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:34 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:34.771722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:34.772330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:34.779299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:34.779777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:34.780208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:34.780891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:34.781365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:34.781785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:34.910121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:34.918115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-069ba0dd-3552-4cb3-91c6-5884ebe2f93f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150210 Sep 01 07:34:34.918671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1128/2271] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:34 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:35.303724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:35.304331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:35.310824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:35.310968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:35.311307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:35.311525 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:35.311742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:35.312425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:35.312874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:35.313332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:35.317315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:35.317803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:35.318247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:35.318964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:35.319415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:35.319838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:35.502736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:35.505739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:35.511449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1ab3193-9d06-4eda-bd64-736db10d0193 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211541 Sep 01 07:34:35.512015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1144/2272] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:35.514365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a249bd5-0f1d-4229-a774-4cc1d4cd821b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.207748 Sep 01 07:34:35.515172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1129/2273] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:35.597528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:35.598054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:35.604319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:35.604788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:35.605253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:35.605920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:35.606354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:35.606766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:35.667162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:35.675493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:35.676919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:35.678068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ae91bf7a-f4c5-4fb0-99a7-bf41d6f1eb4e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084552 Sep 01 07:34:35.678624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1145/2274] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:35.938770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:35.939384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:35.945722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:35.946201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:35.946640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:35.947351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:35.947802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:35.948220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:36.074102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:36.082171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0682e3e5-e392-4a63-8b91-da741babc3a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147270 Sep 01 07:34:36.082734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1130/2275] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:35 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:36.532224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:36.532817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:36.535434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:36.536048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:36.539236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:36.539714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:36.540143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:36.540823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:36.541297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:36.541715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:36.542539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:36.543065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:36.543506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:36.544198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:36.544652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:36.545079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:36.732365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:36.739023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:36.740625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-08b17a41-a2c2-4939-8584-651445010365 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209100 Sep 01 07:34:36.741215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1131/2276] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:36.746182 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:36.746785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:36.747823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c4d8dca-a490-47ab-9502-d03335677978 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.219381 Sep 01 07:34:36.748694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1146/2277] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:36.755618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:36.755618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:36.755618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:36.755618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:36.756095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:36.756095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:36.761006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:36.823650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:36.832113 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:36.833593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:36.834766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81a44d7b-fb8a-4da5-aa7e-0317050d6060 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.092604 Sep 01 07:34:36.835331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1132/2278] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:37.104392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:37.105038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:37.111069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:37.111545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:37.111981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:37.112659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:37.113107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:37.113550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:37.238215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:37.247201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-092f7a20-5170-4111-8b81-9ac13e4da291 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147171 Sep 01 07:34:37.247772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1147/2279] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:37 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:37.762016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:37.762738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:37.768644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:37.769281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:37.769584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:37.770078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:37.770518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:37.771220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:37.771678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:37.772107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:37.776064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:37.776537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:37.776971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:37.777783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:37.778233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:37.778651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:37.954554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:37.963187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0d23a918-a8e6-4245-afa6-127c1e841615 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.204512 Sep 01 07:34:37.963756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1133/2280] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:37.966088 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:37.968209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:37.968815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:37.974317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d8cfbd66-3980-40df-8391-4016834b7a89 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209723 Sep 01 07:34:37.974575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:37.975229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1148/2281] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:37.975363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:37.975554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:37.976250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:37.976711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:37.977220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:38.038426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:38.047050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:38.048488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:38.049666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1f2f19a-02e1-43bd-8f4b-80eec27f6e80 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084996 Sep 01 07:34:38.050225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1134/2282] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:38.268404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:38.269012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:38.275125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:38.275610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:38.276044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:38.276721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:38.277194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:38.277671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:38.404391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:38.412405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-abc13768-318b-44dd-92cb-04faf4dcae14 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148224 Sep 01 07:34:38.412964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1149/2283] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:38 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:38.984428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:38.984986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:38.991508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:38.991989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:38.992426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:38.993126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:38.993598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:38.994026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:38.995178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:38.995801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:39.001964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:39.002782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:39.002908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:39.003527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:39.003968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:39.004383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:39.178830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:39.187124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3a83f4d1-1b66-4248-b70c-ca35d9cc1c7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.206544 Sep 01 07:34:39.187697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1135/2284] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:39.189869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:39.192298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:39.193044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:39.198511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4be323d2-6b20-4798-8433-d8828190ef66 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.207048 Sep 01 07:34:39.198919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:39.199347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1150/2285] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:39.199513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:39.199893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:39.200631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:39.201085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:39.201534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:39.265884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:39.274340 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:39.276287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:39.277451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-123ef40f-0855-4e6a-9c38-1ceb4c246089 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088806 Sep 01 07:34:39.278001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1136/2286] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:39.433175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:39.433784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:39.439655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:39.440130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:39.440565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:39.441278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:39.441723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:39.442139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:39.565848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:39.574384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97f654f2-cdec-4000-8c54-fd308343122a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.145056 Sep 01 07:34:39.574947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1151/2287] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:39 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:40.207829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:40.208436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:40.215116 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:40.215660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:40.216104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:40.216801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:40.217289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:40.217737 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:40.219038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:40.219639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:40.225884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:40.226357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:40.226785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:40.227455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:40.227894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:40.228845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:40.416277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:40.420255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:40.424549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3bbd1457-30ad-4217-aec2-04fe2384ed66 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.220559 Sep 01 07:34:40.425181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1137/2288] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:40.428607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e6c35ef-e2df-4440-b9fe-0f5151c60d76 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213236 Sep 01 07:34:40.429265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1152/2289] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:40.430193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:40.430792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:40.437074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:40.437582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:40.438020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:40.438699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:40.439145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:40.439564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:40.499439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:40.507731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:40.509220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:40.510348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e23d510d-4750-4609-aa15-85ee47493782 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084316 Sep 01 07:34:40.510902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1138/2290] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:40 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:40.595420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:40.596021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:40.601873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:40.602393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:40.602805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:40.604112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:40.604552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:40.604966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:40.732669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:40.740637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ecb11415-509a-4dec-b015-901e62eedd0e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149008 Sep 01 07:34:40.741218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1153/2291] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:40 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:41.446129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:41.446720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:41.450209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:41.450806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:41.453908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:41.454391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:41.454825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:41.455640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:41.456007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:41.456429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:41.456989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:41.457496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:41.457922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:41.458598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:41.459037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:41.459449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:41.647061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:41.650364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:41.656843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0b0a9e6-af49-40e7-9e01-2cc5da7811f9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214768 Sep 01 07:34:41.657443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1139/2292] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:41.659332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-196af7e1-e9ea-417c-abe6-2b8e09e5ed99 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213481 Sep 01 07:34:41.660062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1154/2293] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:41.661851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:41.662447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:41.668060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:41.668539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:41.668970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:41.669692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:41.670136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:41.670556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:41.729617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:41.737947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:41.739377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:41.740498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18ee698d-b0bc-438b-9448-1148587d4c5c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.082154 Sep 01 07:34:41.741051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1140/2294] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:41.761766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:41.762403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:41.768649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:41.769155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:41.769578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:41.770254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:41.770688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:41.771097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:41.896091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:41.904783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b54de489-15fa-4554-8cf6-378ee779ea96 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.147438 Sep 01 07:34:41.905374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1155/2295] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:41 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:42.677563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:42.678218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:42.679371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:42.679976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:42.685334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:42.685827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:42.686272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:42.686967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:42.687080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:42.687425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:42.687631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:42.687851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:42.688067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:42.688767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:42.689236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:42.689652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:42.880252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:42.884191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:42.888650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-103cc7c5-38de-4834-9550-f50f817190df tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212990 Sep 01 07:34:42.889238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1156/2296] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:42.892567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbd02043-0e94-4325-ab5f-0f1368f2d464 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218866 Sep 01 07:34:42.893297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1141/2297] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:42.894182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:42.894781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:42.900869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:42.901375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:42.901807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:42.902480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:42.902922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:42.903338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:42.925447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:42.926065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:42.932084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:42.932671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:42.933183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:42.933942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:42.934472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:42.934944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:42.983955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:42.992593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:42.994047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:42.995181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bbd357f4-81ed-4047-b8b9-a5570b65da6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.105041 Sep 01 07:34:42.995739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1157/2298] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:43.081187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:43.089960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b13947c3-d872-426f-8425-bf46f0feb1ac tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.168471 Sep 01 07:34:43.090509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1142/2299] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:42 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:43.913477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:43.914249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:43.915479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:43.916101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:43.920693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:43.921197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:43.921629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:43.922343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:43.922495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:43.922784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:43.922933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:43.923201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:43.923331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:43.923966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:43.924422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:43.924850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:44.114675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:44.116840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:44.116986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:44.124257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b170a45-7f94-4b69-bc43-3a35dd3a08b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214604 Sep 01 07:34:44.124832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1158/2300] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:44.125462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a5fa272-01cd-4f9d-8e95-ef0799d222bd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213782 Sep 01 07:34:44.126264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1143/2301] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:44.130732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:44.131336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:44.137357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:44.137835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:44.138270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:44.138943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:44.139388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:44.139808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:44.140804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:44.142720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:44.148716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:44.149227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:44.149662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:44.150920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:44.151361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:44.151775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:44.228180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:44.236737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:44.238188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:44.239310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-201a7a5f-a6ef-420f-aaec-de4ffcf628c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.113541 Sep 01 07:34:44.239865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1159/2302] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:44.290680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:44.298846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-21cc700a-7f79-48b9-b7d8-aee694a62064 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171766 Sep 01 07:34:44.299402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1144/2303] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:44 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:45.145160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:45.145773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:45.150540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:45.151159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:45.152276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:45.152754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:45.153225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:45.153916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:45.154365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:45.154786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:45.157402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:45.157884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:45.159721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:45.159721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:45.159721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:45.160055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:45.342892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:45.346603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:45.351208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8fab23b6-a0d9-4d32-94c5-a5409da5f131 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209858 Sep 01 07:34:45.351769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1160/2304] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:45.355402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9cc373b-84c6-4ab3-9a8c-d9365464b62e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208663 Sep 01 07:34:45.356134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1145/2305] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:45.356869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:45.357496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:45.363122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:45.363595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:45.364024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:45.364700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:45.365163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:45.365584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:45.370614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:45.371312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:45.377089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:45.377702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:45.383516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:45.383516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:45.383516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:45.383516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:45.443188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:45.452360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:45.453849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:45.454999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5d7dad5-3d94-40b4-9df6-62e7c656fdfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.102265 Sep 01 07:34:45.455568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1161/2306] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:45 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:45.523189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:45.531659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6eb03bb-27dc-400e-800d-357a0e77445c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.165199 Sep 01 07:34:45.532224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1146/2307] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:45 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:46.372746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:46.373379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:46.375157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:46.375769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:46.379956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:46.380438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:46.380868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:46.381580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:46.382027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:46.382183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:46.382444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:46.382559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:46.382955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:46.383636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:46.384086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:46.385014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:46.569799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:46.580414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:46.584695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05c6005b-638b-4fb0-b7fd-150f02c3b17a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215816 Sep 01 07:34:46.585310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1162/2308] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:46.589014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-53f71663-ddd1-4a2f-a82c-fc7c6de9b714 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217574 Sep 01 07:34:46.601173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1147/2309] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:46.601359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:46.601359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:46.601710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:46.601803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:46.601803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:46.601996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:46.602090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:46.602090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:46.602090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:46.602090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:46.602777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:46.603263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:46.603698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:46.604396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:46.604847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:46.605300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:46.679829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:46.688771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:46.690255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:46.691398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e22f96ca-8507-4899-9d9d-3efb9d2faa85 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.105168 Sep 01 07:34:46.691960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1163/2310] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:46.749244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:46.751489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:46.758695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-13dd95a6-6ef2-4c83-ad3b-ff270637db29 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.168133 Sep 01 07:34:46.759870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1148/2311] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:46 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:47.605339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:47.605932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:47.611744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:47.612539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:47.613018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:47.613481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:47.613770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:47.614167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:47.614612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:47.615030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:47.620280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:47.620765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:47.621230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:47.621926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:47.622379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:47.622805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:47.802106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:47.808545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:47.810504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f18cf39b-07da-4e9b-bc3a-f557ab3a9c50 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209055 Sep 01 07:34:47.811072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1164/2312] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:47.815917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:47.816503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:47.816857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22d17253-d9b0-4f24-92b7-5f86de9f499b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209162 Sep 01 07:34:47.825836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1149/2313] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:47.825836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:47.826132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:47.826237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:47.826334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:47.826334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:47.826334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:47.826334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:47.826665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:47.830308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:47.830899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:47.831220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:47.831908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:47.832363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:47.832782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:47.910304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:47.918781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:47.920216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:47.921391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec797cc3-0b68-481e-b6e8-bfdcf2ba11ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.109388 Sep 01 07:34:47.921954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1165/2314] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:47.977239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:47.985523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b6f13319-f612-4b80-bd94-ffa814d49a08 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166754 Sep 01 07:34:47.986089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1150/2315] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:47 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:48.831190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:48.831789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:48.838649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:48.839129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:48.839129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:48.839346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:48.839553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:48.840224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:48.840662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:48.841075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:48.845444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:48.845932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:48.846369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:48.847051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:48.847504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:48.847933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:49.271446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:49.279070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:49.280627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4190d7b6-3078-4224-b198-1002b98c2d15 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.446227 Sep 01 07:34:49.293301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1151/2316] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:49.293301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:49.293301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:49.293689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7829561-d0ba-4cdb-a636-809b49ef961f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.460216 Sep 01 07:34:49.293689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1166/2317] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:49.293881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:49.293980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:49.294069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:49.294155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:49.294239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:49.294239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:49.294412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:49.294844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:49.299393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:49.299393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:49.299747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:49.300421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:49.300865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:49.301305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:49.375692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:49.384707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:49.386194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:49.387331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2ee46b9-11c4-49f3-afb6-f1738f97602a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.105215 Sep 01 07:34:49.387915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1152/2318] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:49.444281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:49.452993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-929a3aae-353a-456d-824b-4338d189791a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163971 Sep 01 07:34:49.453581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1167/2319] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:49 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:50.303765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:50.304370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:50.308950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:50.309629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:50.311028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:50.311523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:50.311966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:50.312663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:50.313143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:50.313583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:50.315439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:50.315909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:50.316335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:50.317021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:50.317492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:50.317898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:50.502158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:50.505254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:50.510621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9363d85-f96a-40a3-a55f-46b695e604ac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210683 Sep 01 07:34:50.511273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1153/2320] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:50.513510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd602054-6e2f-4d53-a4f7-404e232e7266 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209394 Sep 01 07:34:50.514199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1168/2321] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:50.516193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:50.527358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:50.527573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:50.527573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:50.527757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:50.527757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:50.527757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:50.527757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:50.528100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:50.528193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:50.528193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:50.528376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:50.528376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:50.528376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:50.528376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:50.528709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:50.599661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:50.608242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:50.609710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:50.610845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f37ef6a-5704-41af-8812-7a27218d9cc3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.098662 Sep 01 07:34:50.611397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1154/2322] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:50 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:50.682451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:50.690500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34beecc1-e41b-4633-bac2-8842c4af43b4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.175512 Sep 01 07:34:50.691074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1169/2323] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:50 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:51.532209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:51.532831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:51.536344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:51.536947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:51.539346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:51.539836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:51.540282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:51.540973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:51.541454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:51.541885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:51.543618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:51.544134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:51.544568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:51.545279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:51.545723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:51.546141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:51.729423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:51.732810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:51.737735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2951427b-a31e-473d-af7d-ed4ba1a341ee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209456 Sep 01 07:34:51.738330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1155/2324] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:51.740958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15233907-ae2a-486e-92b0-91704dcb5385 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208473 Sep 01 07:34:51.741673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1170/2325] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:51.742694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:51.743292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:51.749416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:51.749897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:51.750331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:51.751008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:51.751455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:51.751873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:51.758238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:51.758850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:51.766010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:51.766504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:51.767022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:51.767722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:51.768580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:51.768580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:51.826743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:51.835256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:51.836702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:51.837865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d3590b8-0621-4f41-b587-617c4cdcee9d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.098669 Sep 01 07:34:51.838411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1156/2326] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:51.910439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:51.918416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a36594f4-0b7d-41fd-98b9-c556e832a6ff tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.174835 Sep 01 07:34:51.918970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1171/2327] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:51 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:52.759854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:52.760453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:52.765782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:52.766397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:52.767334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:52.767835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:52.768277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:52.769007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:52.769488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:52.769914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:52.772854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:52.773368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:52.773806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:52.774525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:52.775479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:52.775901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:52.960257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:52.967536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:52.969466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0d0cac92-56bf-424b-af6f-df66f5feeb5d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213444 Sep 01 07:34:52.970132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1157/2328] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:52.974747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:52.975424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:52.975620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2b0faa9-9ad8-47b5-a4d1-466a931b609b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213984 Sep 01 07:34:52.976335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1172/2329] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:52.981083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:52.981584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:52.981728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:52.982173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:52.982689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:52.983459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:52.984361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:52.984509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:52.987309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:52.987790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:52.988222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:52.988900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:52.989374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:52.989790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:53.072374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:53.080897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:53.082382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:53.083528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-199d1749-5b35-436e-b51b-55aba7767fea tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.112407 Sep 01 07:34:53.084088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1158/2330] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:53.138418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:53.146752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b01ee12d-a59b-4cae-9bda-82c021eb1887 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.169105 Sep 01 07:34:53.147305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1173/2331] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:52 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:53.996813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:53.997460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:54.003572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:54.003774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:54.004215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:54.004332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:54.004513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:54.005169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:54.005623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:54.006051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:54.010153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:54.010648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:54.011076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:54.011758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:54.012194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:54.012608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:54.196628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:54.202978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:54.206061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a3351f1-5814-4655-9476-8576ac42b051 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212977 Sep 01 07:34:54.206644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1159/2332] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:54.211061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:54.211662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:54.212047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9649d835-d8dc-4453-9180-f317782f9f56 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212123 Sep 01 07:34:54.221253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1174/2333] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:54.221253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:54.221522 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:54.221634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:54.221725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:54.221725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:54.221725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:54.221725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:54.222053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:54.224059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:54.224681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:54.225379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:54.226940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:54.227462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:54.228606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:54.243318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:54.291530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:54.300159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:54.301623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:54.302750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2476c593-8358-460c-a8d9-bb8bffefc264 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095213 Sep 01 07:34:54.303315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1160/2334] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:54.376625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:54.385292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0956987-45aa-4a36-85ce-6b3480761df4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170809 Sep 01 07:34:54.385851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1175/2335] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:54 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:55.227464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:55.228655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:55.233612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:55.234217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:55.235382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:55.235875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:55.236317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:55.237013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:55.237500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:55.237929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:55.240565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:55.241037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:55.241508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:55.242185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:55.242631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:55.243049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:55.420716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:55.427615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:55.429426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ef953614-7732-4585-a85c-116ff55e3f3c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.205806 Sep 01 07:34:55.430010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1161/2336] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:55.435313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:55.435910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:55.436359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8042f9a5-c98d-4f8e-a364-8673742d4103 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.206436 Sep 01 07:34:55.447508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1176/2337] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:55.447508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:55.447849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:55.447960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:55.448058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:55.448058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:55.448058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:55.448058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:55.448392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:55.448582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:55.449054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:55.449565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:55.450247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:55.450683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:55.451093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:55.532409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:55.541579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:55.543046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:55.544196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ada0ba8b-fcf5-422d-8874-0cf109ed7f5a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.113270 Sep 01 07:34:55.544753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1162/2338] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:55.597506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:55.606221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-056c4ad2-f41b-4c4a-9b2d-7f307e38c725 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.168059 Sep 01 07:34:55.606780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1177/2339] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:55 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:56.455234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:56.455876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:56.457400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:56.458007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:56.458137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:56.463397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:56.463886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:56.464325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:56.464450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:56.464804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:56.465009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:56.465270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:56.465489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:56.465919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:56.466031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:56.466384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:56.466806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:56.643578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:56.652232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6a1e5f1d-03f3-44c8-bc46-6b25cd32d73b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.200913 Sep 01 07:34:56.652816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1163/2340] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:56.657303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:56.657908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:56.663645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:56.664131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:56.664566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:56.665802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:56.666255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:56.666676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:56.687845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:56.695927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38867913-0742-4e5d-9674-4eb2867d1eac tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.242255 Sep 01 07:34:56.696494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1178/2341] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:56.700773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:56.701393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:56.709194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:56.709194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:56.709194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:56.709194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:56.709634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:56.709634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:56.727598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:56.736715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:56.738172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:56.739308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47867fa8-76e6-4345-9df6-2906ce6901f0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085558 Sep 01 07:34:56.739864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1164/2342] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:56 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:56.840225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:56.848471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb7912d5-ef1a-4be7-b09f-b86a40ca5372 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.151046 Sep 01 07:34:56.849027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1179/2343] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:56 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:57.673745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:57.674417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:57.676378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:34:57.676520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 (ip 10.222.0.46) !!! Sep 01 07:34:57.684274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:57.684761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:57.685235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:57.685924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:57.686378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:57.686807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:57.702425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:34:57.717016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:57.717654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:57.724163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:57.724647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:57.725084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:57.725800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:57.726408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:57.726670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:57.861081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:57.869884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eff97c6c-16e6-4933-86ef-f3edc2147e57 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.199986 Sep 01 07:34:57.870728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1165/2344] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:57.875215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:57.875968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:57.881610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:57.882094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:57.882529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:57.883218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:57.883732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:57.884157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:57.891440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:57.900187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea5fc5d6-1db9-4dd3-95e1-fd3ffc1bdb16 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.186467 Sep 01 07:34:57.900746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1180/2345] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:57.905269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:57.905872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:57.911414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:57.911895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:57.912323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:57.913000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:57.913466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:57.913879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:57.949837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:57.958434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:57.959857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:57.960993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f578bc1c-3452-4374-bfd4-efc6fe6e2e52 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089460 Sep 01 07:34:57.961586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1166/2346] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:58.043223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:58.051886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c2cd7e4-4368-4734-a2ef-1ffd6b773948 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150080 Sep 01 07:34:58.052445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1181/2347] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:57 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:58.891372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:58.891985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:58.898347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:58.898828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:58.899264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:58.899946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:58.900397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:58.900827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:58.921475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:58.922079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:58.929599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:58.930063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:58.930490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:58.931819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:58.932285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:58.932680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:59.094917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:59.102131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:59.103727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a195ec02-7de2-447b-b863-5868197edc02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216437 Sep 01 07:34:59.104309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1167/2348] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:34:59.108959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:59.109874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:59.110826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8d1486d6-bfd9-4d55-bf18-53dd2b5b51e9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.193137 Sep 01 07:34:59.116017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:59.116511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:59.116953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:59.117743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:59.118208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:59.119260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:59.122638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1182/2349] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:34:59.132682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:34:59.133313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:34:59.139187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:59.139663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:59.140355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:59.141033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:34:59.141501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:34:59.141916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:34:59.189747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:59.199577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:59.201018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:59.202242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b03838d4-ff4c-4d3f-8a4b-58b9e7f2184e tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097019 Sep 01 07:34:59.202839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1168/2350] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:34:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:34:59.286660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:34:59.295402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4374d9b8-504c-407c-8b2f-a3cb3c9a7569 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171870 Sep 01 07:34:59.295959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1183/2351] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:34:59 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:00.124455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:00.125051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:00.131521 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:00.131999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:00.132426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:00.133109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:00.133584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:00.134004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:00.135594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:00.136203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:00.142884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:00.143362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:00.143792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:00.144508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:00.144952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:00.145399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:00.331075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:00.336814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:00.340086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f48af704-d8b6-4521-b9b2-03cb8a4b252d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.219461 Sep 01 07:35:00.340863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1169/2352] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:00.345416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:00.345952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:00.351939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:00.352422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:00.352857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:00.353582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:00.354031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:00.354452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:00.354568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-791d66d4-3383-48d9-9671-f6a17f926efa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.222645 Sep 01 07:35:00.355040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1184/2353] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:00.359984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:00.360617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:00.367450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:00.367932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:00.368365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:00.369077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:00.369551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:00.370575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:00.419237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:00.427933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:00.429398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:00.430757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68abf9e2-bb10-4972-ab9e-1113ed0b4902 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089141 Sep 01 07:35:00.431346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1170/2354] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:00.511538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:00.519767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a506421d-4504-44d0-87ef-98b6619d52fb tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163789 Sep 01 07:35:00.520325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1185/2355] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:00 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:01.361609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:01.362251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:01.368847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:01.371248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:01.371248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:01.371248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:01.371534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:01.371916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:01.377487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:01.377487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:01.379563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:01.385603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:01.386182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:01.386695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:01.387474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:01.388000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:01.388520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:01.573984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:01.580738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:01.582139 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-35474329-ed3b-4854-8c2f-fa37c615bce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.224429 Sep 01 07:35:01.582743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1171/2356] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:01.587147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:01.588246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:01.589868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be1ade95-fa29-4af5-a569-a6456885b21e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217326 Sep 01 07:35:01.591229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1186/2357] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:01.594352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:01.594825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:01.595192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:01.595423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:01.595959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:01.596649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:01.597099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:01.597545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:01.601032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:01.602566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:01.602566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:01.602798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:01.603895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:01.604382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:01.680095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:01.688683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:01.690149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:01.691286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28417682-4e3b-42ce-9a0c-2cac3ef624f2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.107641 Sep 01 07:35:01.691845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1172/2358] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:01 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:01.748169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:01.756349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2de9895e-d579-4d41-b53e-e555daa7daf4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.164877 Sep 01 07:35:01.756918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1187/2359] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:01 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:02.603681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:02.604357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:02.610756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:02.611249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:02.611660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:02.612058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:02.612288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:02.612408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:02.612818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:02.613283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:02.618549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:02.619907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:02.620186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:02.620849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:02.621316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:02.621730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:02.799561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:02.807522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:02.808430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ad586c6-edbe-4f97-9280-79cd15ea6f60 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209105 Sep 01 07:35:02.809009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1173/2360] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:02.813602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:02.814430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:02.815959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f0991d9-bbbc-42e8-8734-f59852387268 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208149 Sep 01 07:35:02.816704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1188/2361] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:02.820191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:02.820683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:02.821145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:02.821829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:02.822279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:02.822704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:02.826519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:02.827390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:02.833236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:02.833717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:02.834149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:02.834835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:02.835280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:02.835704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:02.889085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:02.898033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:02.899467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:02.900629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0206171c-a560-4e0d-8758-3af825fd96c5 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090663 Sep 01 07:35:02.901198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1174/2362] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:02.981615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:02.989672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c0721535-aa16-4a45-b695-f9d1055e595e tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166861 Sep 01 07:35:02.990222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1189/2363] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:02 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:03.829298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:03.829905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:03.836466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:03.836643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:03.837089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:03.837242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:03.837395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:03.838591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:03.839042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:03.839461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:03.843965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:03.844441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:03.844871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:03.845572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:03.846018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:03.846437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:04.030481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:04.033408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:04.039073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-24716069-b047-4997-9f9f-f3138702648a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213570 Sep 01 07:35:04.039643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1175/2364] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:04.042050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5a5c3a5-99f8-472b-8fb2-1c7b452bb6f4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209288 Sep 01 07:35:04.042603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1190/2365] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:04.045090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:04.045705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:04.047543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:04.048249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:04.052073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:04.052816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:04.053488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:04.054200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:04.054326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:04.054650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:04.054780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:04.055135 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:04.055339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:04.056101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:04.056635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:04.057145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:04.146061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:04.157933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:04.159392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:04.160555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-14265f97-cc4a-4569-a583-1647da4dbd00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.120000 Sep 01 07:35:04.161386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1176/2366] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:04.226664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:04.234965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0b4aa0d-c00a-4fe6-aa7d-74a518f9bafd tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.191145 Sep 01 07:35:04.235544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1191/2367] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:04 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:05.060596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:05.061314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:05.063307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:05.063917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:05.067815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:05.068300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:05.068767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:05.069478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:05.069928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:05.070220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:05.070345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:05.070701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:05.071133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:05.072307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:05.072770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:05.073223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:05.077081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:05.262605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:05.266997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:05.271091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c658ec4-5798-45a1-be64-0ff55988696d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211461 Sep 01 07:35:05.271604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1192/2368] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:05.275558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d682d1a-58b9-40f2-9f61-6346ef82a934 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218809 Sep 01 07:35:05.276118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:05.285386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:05.285540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1177/2369] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:05.285672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:05.285672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:05.285672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:05.285672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:05.286039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:05.286039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:05.288898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:05.289543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:05.295638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:05.296135 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:05.296573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:05.297307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:05.297766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:05.298198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:05.359019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:05.367982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:05.370003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:05.371149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4d6e177-db8b-470f-a405-0f6b0c2b5828 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.098516 Sep 01 07:35:05.371715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1193/2370] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:05.442902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:05.451785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eda24c60-bfdf-478e-8ec9-ba3276320347 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.174037 Sep 01 07:35:05.452354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1178/2371] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:05 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:06.292959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:06.293597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:06.296431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:06.297044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:06.300354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:06.300829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:06.301284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:06.301964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:06.302407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:06.302818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:06.303600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:06.304089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:06.304561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:06.305290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:06.305770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:06.306300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:06.490681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:06.498857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ebac10e-3e02-4c4a-9334-5305630ad205 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210395 Sep 01 07:35:06.499431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1194/2372] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:06.502020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:06.503833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:06.504432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:06.510704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:06.511184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:06.511491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-769a11d4-c6ad-483e-925d-0a613ace9986 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218837 Sep 01 07:35:06.511622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:06.513484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1179/2373] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:06.513638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:06.513638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:06.513638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:06.516704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:06.518447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:06.522876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:06.523371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:06.523809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:06.524502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:06.524997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:06.525985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:06.583254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:06.592491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:06.593948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:06.595190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-49ded094-b0b3-4078-9402-8e4f4350cf3f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.094856 Sep 01 07:35:06.595752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1195/2374] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:06 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:06.668015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:06.675990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba0d89b3-1801-46ad-a78c-213035286943 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163031 Sep 01 07:35:06.676552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1180/2375] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:06 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:07.521253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:07.521854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:07.530026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:07.530870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:07.531607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:07.531743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:07.532350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:07.532534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:07.533074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:07.533842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:07.539156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:07.539638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:07.540080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:07.541563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:07.542016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:07.542439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:07.730674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:07.733473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:07.739025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3b7b27ec-ef94-4297-946d-f77a3cb689e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210979 Sep 01 07:35:07.739590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1181/2376] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:07.741652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93257802-eaf5-4df2-b22e-5170d79f9021 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.224223 Sep 01 07:35:07.752315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1196/2377] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:07.752505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:07.752505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:07.752707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:07.752707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:07.752898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:07.752898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:07.752898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:07.752898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:07.753251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:07.753596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:07.757611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:07.758037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:07.758624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:07.758794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:07.759469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:07.759936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:07.760340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:07.836704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:07.846473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:07.847922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:07.849058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67a133ff-4671-41a9-ae7e-3b573fca93ef tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.108562 Sep 01 07:35:07.849648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1182/2378] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:07.902751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:07.910736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84733c02-76b0-4e3f-bc45-5c6d0abd7b57 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.167628 Sep 01 07:35:07.911290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1197/2379] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:07 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:08.759485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:08.760097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:08.761536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:08.762109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:08.767028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:08.767542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:08.768476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:08.768597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:08.769023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:08.769184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:08.769477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:08.769610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:08.769992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:08.770674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:08.771119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:08.771536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:08.966492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:08.972900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:08.974805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3cdb521f-8b6d-49a9-a8b7-43c1e67150ca tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.219374 Sep 01 07:35:08.975453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1183/2380] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:08.980812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:08.981538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:08.982102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67c67849-1793-4ce4-846f-5639f0c8dda0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.224365 Sep 01 07:35:08.982824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1198/2381] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:08.987705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:08.988273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:08.988781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:08.989578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:08.990105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:08.990546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:08.995458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:08.995668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:09.001564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:09.002067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:09.002492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:09.003291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:09.003733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:09.004259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:09.056225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:09.064960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:09.066428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:09.067567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5d9f559e-e783-4a35-859c-95aaf759936a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.091210 Sep 01 07:35:09.068127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1184/2382] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:09.146314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:09.154832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5dea6001-0f9e-49d8-a2d5-6304344ea550 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.163391 Sep 01 07:35:09.155382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1199/2383] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:08 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:09.998117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:09.998731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:10.002957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:10.003562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:10.005165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:10.005657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:10.006097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:10.006790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:10.007243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:10.007667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:10.010557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:10.011038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:10.011465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:10.012140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:10.012589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:10.013007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:10.197975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:10.202208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:10.206110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f84e1a71-ef18-492e-9068-d184aae3b3eb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212418 Sep 01 07:35:10.206681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1185/2384] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:10.210537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-77a56e8a-7841-4d7d-939d-e18a8aa9ffe9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211579 Sep 01 07:35:10.211264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:10.211393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1200/2385] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:10.215571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:10.216166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:10.222198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:10.222673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:10.223115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:10.223789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:10.224127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:10.224238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:10.224637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:10.230365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:10.230845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:10.231280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:10.231968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:10.232415 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:10.232837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:10.313602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:10.322156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:10.323579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:10.324704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5f1a89c-664e-4181-8058-cacc04574c0d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.117125 Sep 01 07:35:10.325292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1186/2386] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:10.376388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:10.384483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb3ab6ef-1cd3-4a5f-951e-f85fd05874ea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.172477 Sep 01 07:35:10.385036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1201/2387] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:10 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:11.226904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:11.227510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:11.231611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:11.232214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:11.234537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:11.235014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:11.235447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:11.236129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:11.236575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:11.236995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:11.238569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:11.239075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:11.239678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:11.240352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:11.240795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:11.241236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:11.430873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:11.438177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:11.439077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8d09d5b-be8a-444f-aab5-2a641a3f0aa5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215958 Sep 01 07:35:11.439653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1187/2388] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:11.444153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:11.444819 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:11.447723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74390959-a16d-495a-9cb5-65474b1db3fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220574 Sep 01 07:35:11.448464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1202/2389] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:11.450706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:11.451195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:11.451909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:11.452695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:11.453249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:11.453759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:11.460813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:11.461440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:11.468023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:11.468500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:11.468929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:11.470273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:11.470720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:11.471141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:11.516868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:11.526073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:11.527524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:11.528702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fdf6b419-e4e1-44e8-b8ca-2c6dcdfd6a4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088104 Sep 01 07:35:11.529291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1188/2390] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:11.611267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:11.619508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61682b9a-b1c7-462b-9584-b67c92d4f87c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.162388 Sep 01 07:35:11.620077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1203/2391] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:11 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:12.459747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:12.460358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:12.466823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:12.467309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:12.467751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:12.468436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:12.468892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:12.469345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:12.470194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:12.470793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:12.477058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:12.477554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:12.478489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:12.479162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:12.479599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:12.480009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:12.656618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:12.664741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-43affdf1-7673-439b-bbfb-e7a05772951a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208808 Sep 01 07:35:12.665330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1189/2392] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:12.667666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:12.670472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:12.671666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:12.676619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60279e03-4d95-4b9b-b002-34ef5ed923aa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210117 Sep 01 07:35:12.676962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:12.677482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1204/2393] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:12.680673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:12.681789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:12.682508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:12.682691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:12.682966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:12.683284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:12.683416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:12.689050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:12.689570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:12.690001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:12.690692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:12.691137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:12.691551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:12.750820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:12.759563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:12.760994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:12.762192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b3cf023c-ee4a-4de2-9a44-a14e4633e272 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095429 Sep 01 07:35:12.770628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1190/2394] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:12 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:12.834943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:12.843473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5114c8b7-c3eb-4d73-8022-80557e4f2c0f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.165166 Sep 01 07:35:12.844029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1205/2395] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:12 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:13.685461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:13.685997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:13.692788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:13.693315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:13.693768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:13.694470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:13.694936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:13.696148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:13.701521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:13.702224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:13.709367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:13.709845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:13.710272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:13.710956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:13.711407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:13.711825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:13.890919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:13.894754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:13.899257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8921d3d3-5676-47e0-9f08-d8f8089bf676 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217763 Sep 01 07:35:13.900393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1191/2396] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:13.905004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:13.905635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:13.908498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3340b793-9293-4512-9f1d-5516460939b0 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212433 Sep 01 07:35:13.916707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1206/2397] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:13.916707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:13.916707 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:13.918429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:13.918894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:13.919335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:13.919787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:13.920034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:13.920270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:13.920491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:13.920702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:13.921025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:13.921413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:13.921860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:13.922280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:13.993569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:14.002892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:14.004256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:14.005460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-916ccac5-d8bf-43e0-90da-a9acab441dfb tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.103971 Sep 01 07:35:14.006017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1192/2398] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:14.076458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:14.084526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5af73fa3-1bc1-43f2-8ea4-b0775de6eded tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.174513 Sep 01 07:35:14.085083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1207/2399] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:13 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:14.921794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:14.922768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:14.929898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:14.930511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:14.936624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:14.937142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:14.937601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:14.937823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:14.938305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:14.938447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:14.938731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:14.938863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:14.939175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:14.939410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:14.939855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:14.940273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:15.129343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:15.131549 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:15.132405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:15.138783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21f292e8-d781-40bf-ac93-1230e0aa2c13 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212689 Sep 01 07:35:15.139362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1208/2400] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:15.141015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-538bb9e5-9086-45be-b8c3-d9dda79b64af tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.224543 Sep 01 07:35:15.141631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1193/2401] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:15.144158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:15.144760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:15.146701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:15.147645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:15.151454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:15.151938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:15.152371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:15.153059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:15.153560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:15.153960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:15.155457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:15.156009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:15.156517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:15.157309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:15.157852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:15.158347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:15.221354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:15.230741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:15.232163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:15.233508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4dbe73c-162a-414c-bd08-f6ef7eafcee7 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.093208 Sep 01 07:35:15.234067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1209/2402] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:15.305837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:15.313885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d66980c2-c2a7-4dcd-ac26-5bdb00be58a3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171091 Sep 01 07:35:15.314439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1194/2403] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:15 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:16.160788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:16.161461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:16.162398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:16.163010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:16.168546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:16.169026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:16.169489 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:16.169901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:16.170204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:16.170383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:16.170654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:16.170816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:16.171098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:16.171497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:16.171946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:16.172367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:16.357654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:16.364121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:16.365783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ecedd9ae-0784-46c9-bd14-b0c8a22489d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208942 Sep 01 07:35:16.366351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1210/2404] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:16.371345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:16.371936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:16.373012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-208fae2b-b200-4510-b6e3-c5e714fa6a2b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214308 Sep 01 07:35:16.373637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1195/2405] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:16.380951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:16.380951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:16.380951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:16.380951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:16.381440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:16.381440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:16.386488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:16.387104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:16.393287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:16.393808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:16.394243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:16.394937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:16.395395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:16.395823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:16.444234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:16.453168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:16.454688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:16.455837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e1d29fb4-7b37-47fe-8da1-91e4b82981b3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088580 Sep 01 07:35:16.456403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1211/2406] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:16 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:16.535508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:16.544235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d87d9674-a039-4dd7-9429-000b79aaf1a1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.161470 Sep 01 07:35:16.544802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1196/2407] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:16 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:17.388994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:17.389627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:17.393981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:17.394595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:17.396306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:17.396781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:17.397252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:17.397935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:17.398374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:17.398783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:17.401039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:17.401566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:17.402011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:17.402703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:17.403157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:17.403585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:17.840918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:17.849313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63ad128e-6167-42c9-a3cb-9695f906f7f6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.464025 Sep 01 07:35:17.849706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1212/2408] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:17.851884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:17.854607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:17.855409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:17.860952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-54584997-e6e9-4e92-a4cb-f3b7a79c0966 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.470990 Sep 01 07:35:17.861218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:17.861620 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1197/2409] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:17.862035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:17.862558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:17.863332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:17.863782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:17.864195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:17.866534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:17.867199 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:17.873722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:17.874453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:17.874889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:17.875567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:17.876196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:17.876621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:17.934019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:17.942493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:17.943983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:17.945176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f6f46d3e-bdc6-4335-9e03-f1bd6f747d00 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.094543 Sep 01 07:35:17.945734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1213/2410] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:18.018654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:18.020841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:18.028349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd355509-0701-415a-be18-be79c8d4c456 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.165412 Sep 01 07:35:18.028914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1198/2411] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:17 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:18.871309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:18.871945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:18.878735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:18.879360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:18.879931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:18.880672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:18.881441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:18.881862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:18.882897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:18.883514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:18.890958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:18.891444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:18.891878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:18.892570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:18.893019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:18.893470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:19.077271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:19.080475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:19.085492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff70f46d-d6e7-4467-8856-228959364fb9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218561 Sep 01 07:35:19.086062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1214/2412] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:19.094262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6d2ccf59-ea65-42b6-827a-ca9db3c37bc1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210086 Sep 01 07:35:19.094262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1199/2413] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:19.094482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:19.094482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:19.094735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:19.095331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:19.098172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:19.098878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:19.099515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:19.100383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:19.101047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:19.101496 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:19.101625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:19.102041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:19.102501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:19.103694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:19.104142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:19.104562 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:19.183628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:19.192123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:19.193598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:19.194741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-187c9798-b8e6-421f-855b-8fdb597056d8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.107771 Sep 01 07:35:19.199722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1215/2414] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:19.248154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:19.256262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1879ff7f-1c86-4fac-b279-e4e3a515ad1f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.165794 Sep 01 07:35:19.256824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1200/2415] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:19 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:20.107158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:20.107746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:20.109007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:20.109657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:20.114295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:20.114778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:20.115205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:20.115886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:20.116039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:20.116330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:20.116510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:20.116748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:20.116948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:20.117667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:20.118120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:20.118561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:20.305470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:20.309050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:20.314384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-86d1a92e-c336-4c48-b3cd-06b694430263 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209130 Sep 01 07:35:20.315141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1201/2416] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:20.318340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6be91eee-a8ac-4217-b718-97a6912aa7ba tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215353 Sep 01 07:35:20.319157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1216/2417] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:20.324270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:20.325038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:20.330856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:20.331335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:20.331793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:20.332382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:20.332510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:20.332912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:20.333031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:20.333355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:20.338667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:20.339152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:20.339587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:20.340277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:20.340739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:20.341170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:20.421232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:20.429987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:20.432020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:20.433103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-22f8510b-ff4b-4065-8f5d-f45067a93f15 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.117248 Sep 01 07:35:20.433681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1202/2418] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:20.482602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:20.490971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33241644-4374-4c83-ab16-11187af9ba73 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170869 Sep 01 07:35:20.491575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1217/2419] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:20 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:21.335839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:21.336484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:21.340832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:21.341462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:21.344431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:21.344948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:21.345448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:21.346141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:21.346598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:21.347025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:21.347787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:21.348264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:21.348695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:21.349401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:21.349849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:21.350267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:21.537943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:21.541626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:21.546798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-147d2fdf-246d-425a-aefb-d8d50e6accc0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214782 Sep 01 07:35:21.549153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1203/2420] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:21.549569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a405d6e4-a4c7-44e0-9d33-b4d7e7049fd3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213923 Sep 01 07:35:21.550248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1218/2421] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:21.552202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:21.552804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:21.559011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:21.559493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:21.559929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:21.560613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:21.561069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:21.561520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:21.568262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:21.568864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:21.574555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:21.575024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:21.575445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:21.576115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:21.576553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:21.576965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:21.632445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:21.641350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:21.643323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:21.644460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8b432d0b-47c2-4746-a0a1-878cbbaeeae2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095928 Sep 01 07:35:21.645016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1204/2422] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:21 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:21.718754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:21.726732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3a8d1161-3f32-4aa1-8507-7f17724b1805 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.162058 Sep 01 07:35:21.727293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1219/2423] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:21 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:22.567297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:22.567909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:22.571156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:22.572384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:22.575049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:22.575534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:22.575966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:22.576684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:22.577158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:22.577586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:22.578731 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:22.579206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:22.579635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:22.580313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:22.580755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:22.581209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:22.771423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:22.774308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:22.779760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6fdb2974-2942-45da-9225-039a03ad5ce5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216392 Sep 01 07:35:22.780536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1205/2424] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:22.782846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b49735b2-05b3-47e8-a169-9c72e552f67c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215498 Sep 01 07:35:22.783409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1220/2425] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:22.787833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:22.788554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:22.794757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:22.795267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:22.795704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:22.796388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:22.796833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:22.797284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:22.797866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:22.798474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:22.804153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:22.804634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:22.805071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:22.805814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:22.806904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:22.807328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:22.879931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:22.888371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:22.889845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:22.891241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-740cba59-46bd-42bb-a054-52b142a3e4e4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097035 Sep 01 07:35:22.891797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1206/2426] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:22.942259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:22.950399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33fecace-f752-4c42-850b-b408fb940897 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166054 Sep 01 07:35:22.950958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1221/2427] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:22 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:23.800575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:23.801258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:23.803743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:23.804468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:23.807726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:23.808217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:23.808673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:23.809382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:23.809839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:23.810264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:23.810720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:23.811193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:23.811651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:23.812397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:23.812843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:23.813295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:23.999129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:24.002920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:24.007494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48405c3a-c3a3-4db7-a371-b8446954312a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210719 Sep 01 07:35:24.008067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1207/2428] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:24.021737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ace2934a-2c29-42d0-a7ec-d0290e77ba50 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211900 Sep 01 07:35:24.021737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1222/2429] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:24.021978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:24.021978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:24.022144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:24.022144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:24.022330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:24.022330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:24.022330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:24.022330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:24.022661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:24.022863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:24.023272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:24.023756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:24.024179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:24.024931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:24.025429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:24.025846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:24.107520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:24.115902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:24.117368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:24.119009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d83aeba4-8140-4105-9d79-7bda233c9f21 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.109536 Sep 01 07:35:24.119566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1208/2430] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:24.174278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:24.184005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b2b69a8d-1b31-44ee-a835-a4d86109e7a2 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.170651 Sep 01 07:35:24.184560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1223/2431] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:24 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:25.029361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:25.030106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:25.034305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:25.034911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:25.036342 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:25.036825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:25.037293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:25.037982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:25.038433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:25.038852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:25.041443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:25.041921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:25.042351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:25.043026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:25.043468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:25.043883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:25.225325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:25.232662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:25.234224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5f51c79c-bf40-4b15-a1be-b86f1d79b17f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208714 Sep 01 07:35:25.234796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1209/2432] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:25.239175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:25.239914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:25.244903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2684ea3b-8fac-423c-bfa7-761c485a7a6b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215294 Sep 01 07:35:25.245538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:25.245802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1224/2433] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:25.248837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:25.249350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:25.250086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:25.250549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:25.250874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:25.251032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:25.251836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:25.257649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:25.258385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:25.258824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:25.260036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:25.260484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:25.260903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:25.276273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:25.334973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:25.344159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:25.345641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:25.346792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8cfb0549-c3cd-4bab-b3eb-ff63a257be05 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.111086 Sep 01 07:35:25.347356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1210/2434] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:25.400472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:25.408521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c81f9b2b-4171-49ef-818c-d0d2d2795e1a tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.161499 Sep 01 07:35:25.409077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1225/2435] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:25 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:26.254197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:26.254796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:26.261791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:26.262353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:26.262718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:26.263402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:26.263857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:26.264280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:26.266241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:26.266843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:26.273133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:26.273613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:26.274037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:26.274740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:26.275177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:26.275590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:26.462748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:26.466724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:26.471167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7109c6de-7f8b-4bef-92d2-d3205fdd9e44 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.220807 Sep 01 07:35:26.471735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1211/2436] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:26.475100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc64e659-8bf9-4029-a776-542a52cec2e4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212925 Sep 01 07:35:26.477439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:26.478275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:26.479995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:26.485346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:26.485519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1226/2437] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:26.486147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:26.486579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:26.487437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:26.487890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:26.488309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:26.490099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:26.490706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:26.496931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:26.497437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:26.497871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:26.498555 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:26.499000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:26.499416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:26.558434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:26.566940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:26.568374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:26.569542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ea7832c-572e-4ee2-a450-0c854040679d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.096110 Sep 01 07:35:26.570107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1212/2438] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:26.645752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:26.653862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-99a979ec-db4a-4c4d-9951-70c44b6945bf tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.167429 Sep 01 07:35:26.654423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1227/2439] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:26 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:27.492645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:27.493268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:27.495662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:27.496257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:27.499673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:27.500158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:27.500596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:27.501313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:27.501764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:27.502188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:27.502486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:27.502956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:27.503379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:27.504041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:27.504478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:27.504890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:27.694918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:27.698392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:27.703788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4eda94d3-d6f6-48e0-9397-16e6a9acb932 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215086 Sep 01 07:35:27.704645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1213/2440] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:27.707017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c6af1bb-ae2a-4fb5-ba49-6cb602e5a680 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215078 Sep 01 07:35:27.707739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1228/2441] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:27.708861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:27.709748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:27.713637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:27.714613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:27.716833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:27.717534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:27.718171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:27.718870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:27.719483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:27.720341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:27.724578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:27.725061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:27.725521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:27.727557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:27.728774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:27.729578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:27.794553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:27.803267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:27.804729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:27.805905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0543036a-430a-49d9-8e97-37575572b30b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.100615 Sep 01 07:35:27.806472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1214/2442] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:27 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:27.881244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:27.889356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-697e7a2b-e348-4661-87e9-bfba35f6f2a8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.180330 Sep 01 07:35:27.889925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1229/2443] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:27 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:28.725548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:28.726107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:28.728704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:28.729329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:28.732820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:28.733345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:28.733794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:28.734493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:28.734952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:28.735381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:28.735759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:28.736242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:28.736673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:28.737388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:28.737837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:28.738276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:28.752910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:28.929544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:28.933518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:28.937944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-199d0111-b474-4af8-a49e-71abc8d2ea9e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216378 Sep 01 07:35:28.938515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1215/2444] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:28.941910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e11edec3-62e0-496b-923e-6121322b44e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217500 Sep 01 07:35:28.949097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1230/2445] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:28.949302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:28.949302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:28.949499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:28.949499 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:28.954376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:28.954554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:28.954852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:28.955175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:28.955300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:28.955855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:28.955995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:28.956374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:28.956709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:28.956827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:28.957321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:28.957835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:29.047538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:29.062311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:29.065047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:29.067164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aa917a8e-5d32-40de-8714-ce58e56f50cc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.124974 Sep 01 07:35:29.068138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1216/2446] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:28 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:29.120893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:29.128846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aca0bdfb-393a-43e3-8f15-b877c49e1580 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.185078 Sep 01 07:35:29.129437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1231/2447] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:28 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:29.958343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:29.958957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:29.963371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:29.963976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:29.965918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:29.966399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:29.966830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:29.967512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:29.967964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:29.968381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:29.969914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:29.970389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:29.970818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:29.971521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:29.971970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:29.972386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:30.161993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:30.166398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:30.170853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-984ba537-5c66-4360-9f60-35646624c218 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216396 Sep 01 07:35:30.171424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1217/2448] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:30.175806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:30.176403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:30.180546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf8c6736-ca4b-4a5f-934e-1c9252a06bd5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.221383 Sep 01 07:35:30.181260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1232/2449] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:30.182029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:30.182507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:30.182940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:30.183616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:30.184064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:30.184494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:30.185625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:30.186263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:30.194672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:30.195131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:30.195561 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:30.196250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:30.196689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:30.197156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:30.247395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:30.256303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:30.257810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:30.258978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bb8365ec-540a-4730-878f-977dd4ecdc3a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086634 Sep 01 07:35:30.259559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1218/2450] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:30 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:30.342363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:30.351202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62409d9a-b521-4377-88c8-51426aff9a54 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.168969 Sep 01 07:35:30.351774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1233/2451] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:30 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:31.198591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:31.199245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:31.200921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:31.201578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:31.206092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:31.206585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:31.207021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:31.207736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:31.207859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:31.208210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:31.208349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:31.208649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:31.208788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:31.209354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:31.209792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:31.210204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:31.398917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:31.403547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:31.407509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e84b0216-8c4a-4cc2-b5de-712a40a84c9c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210382 Sep 01 07:35:31.408068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1234/2452] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:31.411885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1e73dee-40aa-4eda-b993-1a098e873735 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217248 Sep 01 07:35:31.421036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:31.422585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1219/2453] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:31.422743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:31.422846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:31.422846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:31.423022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=98 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:31.423022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:31.423022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:31.423022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:31.423379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:31.423379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:31.423379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:31.428162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:31.428657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:31.429100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:31.429821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:31.430280 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:31.430796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:31.491559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:31.499957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:31.501391 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:31.502517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9528c7b-1ef0-43b8-ab31-535f388168ce tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.093556 Sep 01 07:35:31.503062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1235/2454] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:31 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:31.571329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:31.579610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2d202f2-15e5-4583-85e4-74a437212ee4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166250 Sep 01 07:35:31.580169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1220/2455] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:31 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:32.430955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:32.431629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:32.435063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:32.435803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:32.438218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:32.438697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:32.439136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:32.439818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:32.440263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:32.440680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:32.442559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:32.443044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:32.443479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:32.444164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:32.444611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:32.445031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:32.631784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:32.636450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:32.640976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d4db08a-3a06-430d-ab13-4e62d123e09d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213771 Sep 01 07:35:32.641575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1236/2456] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:32.645049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2756128b-953a-406d-942f-f81f1742cf2c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213816 Sep 01 07:35:32.655066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1221/2457] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:32.655231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:32.655231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:32.655452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:32.655551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:32.655639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:32.655724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:32.655724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:32.655724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:32.655724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:32.656040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:32.659242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:32.659806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:32.660313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:32.661012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:32.661492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:32.661915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:32.744237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:32.753038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:32.754508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:32.755650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8609d90c-e1eb-45bf-b9fb-dd1074af8716 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.113174 Sep 01 07:35:32.756210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1237/2458] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:32.811486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:32.819653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c1a74ec0-9384-4d14-83f7-77b8329b5d25 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.173107 Sep 01 07:35:32.820218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1222/2459] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:32 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:33.662541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:33.663167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:33.667941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:33.668549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:33.670193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:33.670668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:33.671106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:33.671782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:33.672222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:33.672641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:33.674945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:33.675423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:33.675856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:33.676533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:33.676980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:33.677430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:33.861890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:33.865904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:33.870690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-72624d74-479a-4c9d-9b6f-e82ae10d74fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212163 Sep 01 07:35:33.871441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1238/2460] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:33.875418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c759a8fe-a274-4e30-b963-26601540e74c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211936 Sep 01 07:35:33.875979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1223/2461] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:33 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:33.880389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:33.880989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:33.887430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:33.887938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:33.888399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:33.888564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:33.889080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:33.889212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:33.889564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:33.889984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:33.895153 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:33.895628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:33.896085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:33.896765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:33.897241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:33.897662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:33.975314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:33.983917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:33.985380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:33.986510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-842cf1a4-74cd-4abc-a705-45f4a39e01d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.102190 Sep 01 07:35:33.987057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1239/2462] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:33 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:34.040134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:34.048780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8771706-b6eb-473b-b6e8-c4b5c5594c9c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.171881 Sep 01 07:35:34.049369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1224/2463] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:33 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:34.891430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:34.892031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:34.896770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:34.897421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:34.898464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:34.898936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:34.899357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:34.900691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:34.901149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:34.901567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:34.904213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:34.904698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:34.905225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:34.905923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:34.906381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:34.906809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:35.074059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:35.082098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46aebc96-756a-4dce-9091-05f455ce3fed tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.194712 Sep 01 07:35:35.082659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1240/2464] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:35.087021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:35.088187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:35.093850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:35.094319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:35.094743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:35.095409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:35.095904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:35.096418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:35.148092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:35.156840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bac17413-1f7e-4720-b895-bcfaa6e6ad4f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.263885 Sep 01 07:35:35.157433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1225/2465] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:35.161778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:35.162376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:35.164246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:35.167945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:35.168423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:35.168857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:35.169565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:35.170013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:35.170432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:35.173002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:35.174474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:35.175632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-464f7194-2a21-4a5c-8030-c03432be0375 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.092044 Sep 01 07:35:35.176203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1241/2466] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:35 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:35.299910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:35.308444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-060fb3cf-0456-4146-b7df-bae59441a651 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150084 Sep 01 07:35:35.308997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1226/2467] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:35 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:36.104287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:36.104866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:36.111287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:36.111756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:36.112183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:36.112864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:36.113332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:36.113750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:36.117550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:36.178317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:36.178928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:36.185781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:36.186265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:36.186701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:36.187399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:36.187851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:36.188276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:36.272359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:36.280501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-110a5073-4853-4c02-b22c-e2e9848ce3d9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.180210 Sep 01 07:35:36.281440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1242/2468] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:36.285941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:36.286540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:36.292986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:36.293576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:36.294319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:36.294703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:36.295151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:36.295571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:36.344395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:36.352703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dab2af20-11b4-40f4-8a1e-d728285ad2c1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.178349 Sep 01 07:35:36.353812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1227/2469] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:36.358189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:36.358794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:36.360762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:36.364533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:36.365022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:36.365501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:36.366188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:36.366680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:36.367105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:36.370769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:36.372205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:36.373364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-541639ba-60d7-4434-9076-8b3a42d4ff16 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.091303 Sep 01 07:35:36.378507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1243/2470] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:36 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:36.494794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:36.502987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc4dd243-5743-49a4-94c4-69b8aca342b3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148246 Sep 01 07:35:36.503571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1228/2471] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:36 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:37.302908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:37.303464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:37.309822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:37.310294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:37.310721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:37.311388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:37.311832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:37.312243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:37.374528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:37.375176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:37.381867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:37.382356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:37.382820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:37.383542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:37.383994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:37.385054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:37.488168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:37.496944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d0c4262-6ed6-49a4-ab39-ec55fd0a7917 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.197898 Sep 01 07:35:37.497553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1244/2472] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:37.502206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:37.502822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:37.508467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:37.508949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:37.509980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:37.510662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:37.511109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:37.511526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:37.533613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:37.541695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ebda76b-0819-441a-a441-d41279ab958b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.171034 Sep 01 07:35:37.542262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1229/2473] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:37.546984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:37.547581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:37.553470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:37.553891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:37.554322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:37.555013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:37.555462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:37.555883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:37.572643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:37.581034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:37.582500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:37.583631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8839c252-9f6d-46fd-a25c-5a35b6093e07 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085170 Sep 01 07:35:37.584189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1245/2474] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:37 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:37.684951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:37.693044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67060e25-ce69-4449-b57b-8400d8303ba4 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.149778 Sep 01 07:35:37.693627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1230/2475] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:37 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:38.518783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:38.519371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:38.525955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:38.526429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:38.526861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:38.527535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:38.528010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:38.528453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:38.562951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:38.563592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:38.569979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:38.570469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:38.570908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:38.571609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:38.572056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:38.572482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:38.704043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:38.712300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f7d9374-e5a5-4b2b-b1aa-4d2134263e43 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.197578 Sep 01 07:35:38.712961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1246/2476] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:38.717485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:38.718156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:38.723867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:38.724432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:38.724930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:38.725723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:38.726171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:38.726595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:38.737469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:38.746297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab6b8444-00f3-4810-ad4f-dfa2150ec40e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.187215 Sep 01 07:35:38.746852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1231/2477] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:38.754622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:38.757876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:38.764164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:38.764763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:38.765590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:38.766369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:38.766881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:38.767367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:38.771730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:38.788683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:38.797762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:38.799205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:38.800346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-73fe3b13-d34f-4f6b-bef0-84af95545c9c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086387 Sep 01 07:35:38.800903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1247/2478] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:38 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:38.893521 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:38.902209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ff70f0b-3e9c-443e-9629-9576138f8623 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.152029 Sep 01 07:35:38.902784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1232/2479] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:38 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:39.733235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:39.733840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:39.740260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:39.740735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:39.741184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:39.741858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:39.742302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:39.742716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:39.767664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:39.768317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:39.774676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:39.775162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:39.775598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:39.776281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:39.776728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:39.777167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:39.922506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:39.930746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7f6f1d0-2af6-427c-b2d7-a98cb157dab1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.201378 Sep 01 07:35:39.931812 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1248/2480] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:39.936133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:39.936733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:39.942234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:39.942697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:39.943122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:39.943798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:39.944230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:39.944649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:39.948384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:39.956454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2cbcbf72-1f98-4407-8604-518ce5c91b38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.193016 Sep 01 07:35:39.957010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1233/2481] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:39.961411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:39.961993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:39.967473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:39.967948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:39.968378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:39.969056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:39.969534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:39.969955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:40.008070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:40.017483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:40.018917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:40.020057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-72abf95c-b07d-4d08-9406-731362ffd973 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087335 Sep 01 07:35:40.020613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1249/2482] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:39 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:40.108365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:40.116600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1b5951d6-2790-4029-8a85-970f6b7a63d8 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.158642 Sep 01 07:35:40.117178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1234/2483] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:39 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:40.951682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:40.952340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:40.958747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:40.959215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:40.959638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:40.960305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:40.960745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:40.961177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:40.977375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:40.977992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:40.984360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:40.984857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:40.985323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:40.986015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:40.986466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:40.986891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:41.155564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:41.162184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:41.163615 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c101b724-247f-4ded-91ce-54912c5b9af4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215861 Sep 01 07:35:41.164185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1250/2484] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:41.169594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:41.170185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:41.170920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30f11d42-a9d7-4797-9956-f8e19abaa5d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.197415 Sep 01 07:35:41.171632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1235/2485] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:41.176570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:41.177176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:41.177697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:41.177834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:41.178830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:41.179519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:41.179963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:41.180382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:41.184081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:41.184559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:41.184993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:41.185699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:41.186144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:41.186563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:41.248583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:41.257247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:41.258709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:41.260434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7490fe94-f00a-4875-bbfa-04090b4f4687 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095342 Sep 01 07:35:41.261171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1251/2486] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:41 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:41.329646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:41.338678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1a4b4438-39e3-422a-9477-dc1009e9ba2d tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.164904 Sep 01 07:35:41.339249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1236/2487] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:41 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:42.185372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:42.185979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:42.191479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:42.192089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:42.192371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:42.192854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:42.193326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:42.194009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:42.194456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:42.194877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:42.198307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:42.198789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:42.199222 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:42.199905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:42.200352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:42.200772 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:42.383298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:42.390875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:42.392199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-165a2855-4ef1-4143-afc0-5f391fbdf41f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210623 Sep 01 07:35:42.392771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1252/2488] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:42.397333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:42.397874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:42.399080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85c5700c-69c6-4b82-94f9-797797deece0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211309 Sep 01 07:35:42.400583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1237/2489] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:42.405142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:42.405839 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:42.412162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:42.412639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:42.413074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:42.414175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:42.414665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:42.415090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:42.417999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:42.418490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:42.418922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:42.419618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:42.420061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:42.420477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:42.506358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:42.515732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:42.517197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:42.518327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7db23524-e8af-46f4-8a78-c12146efa329 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.124629 Sep 01 07:35:42.518884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1253/2490] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:42 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:42.568724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:42.577263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cb684b53-6618-4186-bbac-b9a07f3a1f50 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.175580 Sep 01 07:35:42.577822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1238/2491] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:42 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:43.423704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:43.424452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:43.426966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:43.427571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:43.431370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:43.431865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:43.432309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:43.433075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:43.433591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:43.434024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:43.435076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:43.435587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:43.436018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:43.436696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:43.437151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:43.437568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:43.623272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:43.626139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:43.631574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e976237e-0ff5-4900-9e6b-2493b7df9eb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211634 Sep 01 07:35:43.632086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1239/2492] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:43.634281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd75fc71-6f85-4d81-8c06-75e76b12d07a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214449 Sep 01 07:35:43.641581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1254/2493] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:43.641773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:43.641773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:43.641968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:43.641968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:43.643124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:43.643848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:43.644482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:43.645448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:43.646169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:43.646610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:43.647714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:43.648195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:43.648623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:43.649339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:43.650285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:43.650701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:43.729345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:43.738033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:43.739570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:43.740767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-57cd09d1-371b-42f6-9a87-7f9381d7baf0 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.107777 Sep 01 07:35:43.741453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1240/2494] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:43 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:43.794600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:43.802670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-160bd6fa-3cb4-4e81-a60f-fbeb41102baa tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166908 Sep 01 07:35:43.803226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1255/2495] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:43 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:44.653273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:44.653983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:44.654890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:44.655546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:44.660397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:44.660783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:44.661244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:44.661792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:44.661930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:44.662263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:44.662395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:44.662686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:44.662818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:44.663354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:44.663792 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:44.664205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:44.849507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:44.856392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:44.858168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01b78147-43a7-475d-90e0-65fabc3f4602 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208834 Sep 01 07:35:44.858736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1241/2496] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:44.863138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:44.863733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:44.864437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-959bde8c-2b7f-4786-a90a-95aa3e74e55e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213277 Sep 01 07:35:44.865148 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1256/2497] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:44.870073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:44.870554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:44.870985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:44.871668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:44.872119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:44.872539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:44.880738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:44.881362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:44.887019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:44.887515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:44.887926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:44.888586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:44.889021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:44.889456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:44.940233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:44.949020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:44.950481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:44.951633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7fec6bf6-b6af-4be3-8564-b25c3cd501e6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.091987 Sep 01 07:35:44.952327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1242/2498] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:44 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:45.285261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:45.294007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ce62900-bd19-400c-8800-c9594c3068f1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.416835 Sep 01 07:35:45.294568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1257/2499] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:44 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:45.879539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:45.880077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:45.885252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:45.885856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:45.887150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:45.887640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:45.888084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:45.888774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:45.889252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:45.889678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:45.892151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:45.892630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:45.893061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:45.893764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:45.894209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:45.894633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:46.079606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:46.083545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:46.085740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:46.088466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ad20251-8519-4a0e-a6af-92dc16cd4972 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212835 Sep 01 07:35:46.089045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1243/2500] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:46.092692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e173dabb-95e3-4c1d-85d7-67dd3e4657e1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211780 Sep 01 07:35:46.093436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1258/2501] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:46.093666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:46.094410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:46.100095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:46.100584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:46.101026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:46.101818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:46.102279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:46.102707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:46.162907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:46.171824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:46.173313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:46.174453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a8f08b0-6cda-44fc-a6f8-58373b18c51c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084469 Sep 01 07:35:46.175010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1244/2502] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:46 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:46.313970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:46.314596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:46.320591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:46.321064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:46.321522 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:46.322193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:46.322642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:46.323057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:46.450655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:46.458872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e7380735-50a8-456e-a1ca-6cd8c51de752 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148806 Sep 01 07:35:46.459428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1259/2503] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:46 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:47.109668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:47.110270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:47.113471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:47.114085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:47.116308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:47.116789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:47.117243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:47.117932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:47.118383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:47.119417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:47.120886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:47.121396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:47.121834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:47.122511 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:47.122961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:47.123379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:47.307492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:47.311205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:47.315986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ec4d7d33-fce7-4732-bbb8-e58b5fc26c22 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210211 Sep 01 07:35:47.316564 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1245/2504] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:47.319581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6524b5f3-89ea-4eeb-97b2-07f3dee1c99f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209865 Sep 01 07:35:47.320441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1260/2505] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:47.321338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:47.321949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:47.327651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:47.328138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:47.328580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:47.329296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:47.329749 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:47.330176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:47.390180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:47.398861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:47.401133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:47.402268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d7c3c2a-b5bf-4833-8dbb-d0ce3f4fc78d tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084788 Sep 01 07:35:47.402827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1246/2506] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:47 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:47.480289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:47.480886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:47.486852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:47.487325 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:47.487752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:47.488424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:47.488867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:47.489318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:47.615985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:47.624047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8386219d-8b6b-4945-98a5-649691aa25b9 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148216 Sep 01 07:35:47.624608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1261/2507] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:47 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:48.336854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:48.337708 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:48.339879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:48.340490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:48.344223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:48.344709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:48.345163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:48.345855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:48.346306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:48.346723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:48.346835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:48.347317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:48.347748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:48.348427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:48.348872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:48.349322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:48.534356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:48.538189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:48.543125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65f3997e-2800-4e25-b5b5-5758de141243 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210243 Sep 01 07:35:48.543700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1247/2508] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:48.546788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aa606143-56f0-477a-81c6-1438ee0c48dd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210694 Sep 01 07:35:48.547519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1262/2509] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:48.548112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:48.548710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:48.554287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:48.554765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:48.555195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:48.555868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:48.556872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:48.557324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:48.616017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:48.618243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:48.626264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:48.627706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:48.628877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-578bd82b-bb7a-4b84-8f43-9a21685d7fa2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084267 Sep 01 07:35:48.629463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1248/2510] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:48 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:48.644939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:48.645569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:48.651915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:48.652385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:48.652810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:48.653515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:48.653956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:48.654372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:48.783076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:48.791760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-962283d3-2fa1-440e-9923-19dd573c7195 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.150621 Sep 01 07:35:48.792317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1263/2511] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:48 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:49.564993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:49.565619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:49.568360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:49.568987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:49.572682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:49.573185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:49.573616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:49.574302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:49.574748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:49.575168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:49.575938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:49.576410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:49.576833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:49.577528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:49.577969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:49.578381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:49.765080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:49.772668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:49.773872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-48f4e234-b19d-475d-990e-fa17d54424d0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212948 Sep 01 07:35:49.774447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1249/2512] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:49.778857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:49.779455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:49.781539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-123a0a6b-c126-4262-89f3-d667c05f23e3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216848 Sep 01 07:35:49.782189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1264/2513] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:49.785328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:49.785812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:49.786246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:49.786931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:49.787381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:49.787805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:49.812281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:49.812975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:49.818914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:49.819394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:49.819885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:49.820642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:49.821204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:49.821746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:49.849017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:49.858272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:49.859700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:49.860838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a283e45-6df8-4cd4-a66d-5852d930bf9a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085486 Sep 01 07:35:49.861428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1250/2514] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:49 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:49.948601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:49.956632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20bf7989-ffb8-4436-9523-c885d7669092 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.148158 Sep 01 07:35:49.957203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1265/2515] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:49 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:50.802982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:50.803505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:50.803895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:50.804004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:50.810747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:50.810952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:50.811251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:50.811400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:50.811730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:50.811879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:50.812393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:50.812516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:50.812845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:50.812972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:50.813293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:50.813424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:51.004807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:51.008774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:51.013330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e207be29-e818-4606-b9f4-6070db990ac8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213936 Sep 01 07:35:51.013900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1266/2516] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:51.017603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d0e45970-2c96-4ccd-94a4-ff0a75656018 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218349 Sep 01 07:35:51.018366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1251/2517] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:51.022682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:51.023294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:51.026926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:51.027556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:51.032156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:51.032645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:51.033083 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:51.033374 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:51.033855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:51.033990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:51.034286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:51.034416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:51.034807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:51.034971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:51.035420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:51.035843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:51.132928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:51.141629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:51.143081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:51.144223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d139869-2b52-49df-a2f7-5d49abbcfb77 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.129306 Sep 01 07:35:51.144780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1267/2518] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:51 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:51.194375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:51.202468 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6bd4a7f0-63d6-4f28-8334-08573967d43b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.183306 Sep 01 07:35:51.203028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1252/2519] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:51 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:52.035269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:52.035861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:52.038864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:52.039568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:52.046346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:52.046845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:52.047279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:52.047468 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:52.047969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:52.048416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:52.048868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:52.049137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:52.049349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:52.049593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:52.049767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:52.050027 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:52.238736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:52.245908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:52.247488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8fd073ed-0535-469d-831d-1bcff1ef633b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212360 Sep 01 07:35:52.248058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1253/2520] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:52.252899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:52.253530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:52.254135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f66b2f3-0ae1-4441-8913-4ba8db4432d1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.222723 Sep 01 07:35:52.260782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1268/2521] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:52.260978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:52.260978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:52.261503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:52.261609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:52.261714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:52.261817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:52.261817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:52.261817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:52.266424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:52.266900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:52.267335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:52.268017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:52.268460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:52.268876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:52.330145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:52.338589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:52.340025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:52.341185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ca3acbb-9217-4fad-8283-07f46d384273 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.091840 Sep 01 07:35:52.341848 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1254/2522] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:52 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:52.412906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:52.421883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65de02bd-80ef-410d-9677-4349b0c43287 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166175 Sep 01 07:35:52.422453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1269/2523] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:52 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:53.268500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:53.269259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:53.274724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:53.275830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:53.276103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:53.276586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:53.277018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:53.277731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:53.278177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:53.278597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:53.282133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:53.282601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:53.283026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:53.283699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:53.284150 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:53.284565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:53.468416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:53.475493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:53.476531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fdb121b0-897b-45f1-b24c-fd6d3328b42f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.205579 Sep 01 07:35:53.477094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1270/2524] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:53.482052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:53.482639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:53.484212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-63eb78b7-7186-4625-a843-ceb9cc74671a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.219815 Sep 01 07:35:53.484777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1255/2525] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:53.488372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:53.488855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:53.489308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:53.489985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:53.490369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:53.490513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:53.490822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:53.491595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:53.497479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:53.497973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:53.498409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:53.499126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:53.499579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:53.500007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:53.564725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:53.573833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:53.575257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:53.576375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5ea7241-aecb-4137-9c76-ff8343f18a72 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.098365 Sep 01 07:35:53.576928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1271/2526] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:53 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:53.646873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:53.655570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3a000c8-a5a6-4934-94a0-19328e37374b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.169610 Sep 01 07:35:53.656128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1256/2527] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:53 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:54.500053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:54.500681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:54.505903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:54.507065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:54.507710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:54.508184 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:54.508614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:54.509388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:54.509842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:54.510257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:54.513317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:54.513807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:54.514249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:54.514942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:54.515667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:54.516125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:54.701787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:54.704999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:54.709959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48b33300-7961-4dce-ba54-fb5b8d725f9f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214214 Sep 01 07:35:54.710531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1272/2528] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:54.713769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-06d4d736-0b05-4fe2-a489-e954ba978c93 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211837 Sep 01 07:35:54.725952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1257/2529] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:54.726146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:54.726146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:54.726375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:54.726375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:54.726539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:54.726539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:54.726539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:54.726539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:54.726876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:54.726876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:54.727053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:54.727053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:54.727053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:54.727053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:54.727428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:54.727428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:54.793159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:54.801684 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:54.803124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:54.804261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe8417a8-208c-4915-86fc-1c61a0530340 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.092734 Sep 01 07:35:54.805135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1273/2530] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:54 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:54.873436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:54.881477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4690a33a-6db9-4ffb-a731-b2cd33353c1c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.166194 Sep 01 07:35:54.882035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1258/2531] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:54 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:55.731264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:55.731848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:55.733494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:55.734105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:55.738229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:55.738699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:55.739129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:55.739798 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:55.740236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:55.740365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:55.740648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:55.740857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:55.741333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:55.742048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:55.742503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:55.742930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:55.932740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:55.936053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:55.940981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e2e1e31-8785-4560-8e21-f5d923788212 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213656 Sep 01 07:35:55.941653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1274/2532] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:55.946037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:55.946631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:55.948191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-452f89c2-479d-490a-861e-4017293c8f35 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218431 Sep 01 07:35:55.948748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1259/2533] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:55.952297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:55.952785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:55.953242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:55.953924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:55.954368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:55.954788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:55.955033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:55.955642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: 9e1d3249-4d55-40bc-a993-ff010dccc5d5] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:55.962711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:55.963196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:55.963628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:55.964314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:55.964791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:55.965250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:55.969616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:56.028243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:56.036869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:56.038340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:56.039604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-834874a8-dc90-44d6-87e5-5cfe5e5d4961 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.097046 Sep 01 07:35:56.040163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1275/2534] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:55 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:56.109232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:56.117188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2d784760-a4a9-4f4c-9a59-37f7fac1efea tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5" status: 200 len: 1560 microversion: 2.1 time: 0.167176 Sep 01 07:35:56.117780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1260/2535] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:55 2022] GET /compute/v2.1/servers/9e1d3249-4d55-40bc-a993-ff010dccc5d5 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:56.962113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:56.963225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:56.969215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:56.969697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:56.969813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:56.970108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:56.970541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:56.971230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:56.971677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:56.972084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=98 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:35:56.972217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:56.977412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:56.977898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:56.978951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:56.979797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:56.980268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:56.980698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:57.160528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:57.164489 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:57.169378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3cf5712-89a8-45bf-bbb9-cce3e08b0c16 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211062 Sep 01 07:35:57.169947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1276/2536] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:57.173258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c98bf44-bb7d-4293-acc5-5d90f2b5ffbe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.207818 Sep 01 07:35:57.173973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1261/2537] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:57.174369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:57.174971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:57.180701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:57.181201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:57.181637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:57.182307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:57.182753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:57.183169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:57.244968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:57.253628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:57.255064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:57.256202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5f4c2d8-9bc2-49e9-93a1-b48d4ef0140b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085351 Sep 01 07:35:57.256757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1277/2538] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:57 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:58.190334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:58.190935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:58.193981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:58.194587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:58.196945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:58.197479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:58.197921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:58.198615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:58.199074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:58.199615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:58.201049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:58.201547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:58.201980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:58.202662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:58.203106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:58.203526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:58.391657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:58.394689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:58.400628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-682d66c9-56cc-46d7-80fb-3cb3c8c7c328 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213820 Sep 01 07:35:58.401216 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1262/2539] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:58.403276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd51e260-4594-4898-9e36-47a24cd0e02f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213135 Sep 01 07:35:58.403957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1278/2540] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:58.405653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:58.406258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:58.412197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:58.413824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:58.413824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:58.413824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:58.414291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:58.414694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:58.475644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:58.485911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:58.487338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:58.488462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fbec259e-ab70-47bc-bc66-62f4ffc3f071 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086344 Sep 01 07:35:58.489227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1263/2541] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:58 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:35:59.421891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:59.422441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:59.426104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:59.426717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:59.428348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:59.428839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:59.429308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:59.429983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:59.430423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:59.430834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:59.433609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:59.434097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:59.434533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:59.435225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:59.435677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:59.436106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:59.615647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:59.624432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ba81476-c2a0-4b0d-97bb-d03a463d29bd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.206519 Sep 01 07:35:59.624958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1279/2542] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:35:59.626707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:59.629366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:35:59.629962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:35:59.635004 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-123211ca-6a93-4534-a66a-f93860670352 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212653 Sep 01 07:35:59.635843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1264/2543] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:35:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:35:59.635970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:59.636187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:59.636594 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:59.637295 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:35:59.637748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:35:59.638163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:35:59.701542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:59.709964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:59.711393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:35:59.712516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2634686-fe5c-4d5c-9690-c60a5efe1840 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086635 Sep 01 07:35:59.713066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1280/2544] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:35:59 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:00.645611 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:00.646180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:00.653193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:00.653681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:00.654117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:00.654810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:00.655264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:00.655691 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:00.656173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:00.656776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:00.663107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:00.663590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:00.664019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:00.664698 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:00.665166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:00.666181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:00.671394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:00.847557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:00.850630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:00.856338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5f5738e7-6978-4856-9fd3-f6cf23cf49ab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214631 Sep 01 07:36:00.856908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1265/2545] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:00.859343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24f65bd7-b046-4b03-aaf2-82fdacfc281f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.206843 Sep 01 07:36:00.860049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1281/2546] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:00.861429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:00.862033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:00.867614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:00.868096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:00.868535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:00.869238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:00.869700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:00.870112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:00.929393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:00.937886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:00.939325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:00.940460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5cef278c-d94d-4ad2-952b-bfe6e48b01b6 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.082545 Sep 01 07:36:00.941012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1266/2547] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:00 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:01.877208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:01.877811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:01.879571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:01.880170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=94 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:01.880295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:01.885638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:01.886113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:01.886479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:01.886601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:01.886964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:01.887199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:01.887403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:01.887638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:01.888057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:01.888218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:01.888563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:01.888986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:02.076257 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:02.079026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:02.084498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5765adc-ab16-4a35-9d65-53853223bf8e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211120 Sep 01 07:36:02.085068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1282/2548] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:02.087019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d87b5e1d-71af-4a38-b376-85fed29a180d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211314 Sep 01 07:36:02.087733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1267/2549] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:02.089876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:02.090666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:02.096422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:02.096895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:02.097354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:02.098036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:02.098480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:02.098896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:02.159073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:02.168179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:02.169644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:02.170774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-780e6add-9ee8-4f7a-86bf-952b41e658ff tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084784 Sep 01 07:36:02.171330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1283/2550] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:02 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:03.107289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:03.107816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:03.108212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:03.108420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:03.114414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:03.114570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:03.114901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:03.115048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:03.115335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:03.115454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:03.116021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:03.116133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:03.116463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:03.116608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:03.116883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:03.117007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:03.302624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:03.309993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:03.311657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f2c681d-abf0-419a-8866-dd20d095baea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208231 Sep 01 07:36:03.312319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1268/2551] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:03.317025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:03.317655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:03.318189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-443f4eaf-27af-49bc-ac43-5eb2baaa1079 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214478 Sep 01 07:36:03.321092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1284/2552] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:03.324467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:03.324958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:03.325418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:03.326111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:03.326563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:03.326987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:03.387153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:03.395851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:03.397349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:03.398486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d9b2f58-17c7-4147-a48d-5ce2986f8966 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085193 Sep 01 07:36:03.399058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1269/2553] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:03 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:04.331810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:04.332414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:04.339459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:04.340377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:04.342169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:04.343008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:04.343626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:04.344505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:04.345281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:04.345868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:04.347705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:04.348292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:04.348850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:04.349667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:04.350220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:04.350922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:04.553465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:04.556772 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:04.563810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab620aa1-4ee8-4c33-9ad4-227a31c975b1 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.235735 Sep 01 07:36:04.564598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1285/2554] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:04 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:04.565843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a9b6f49a-0373-4835-9a0d-ad2f8f5de7da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.230633 Sep 01 07:36:04.566740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1270/2555] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:04.569317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:04.569912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:04.576617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:04.577455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:04.577885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:04.578552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:04.578990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:04.579400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:04.642592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:04.650922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:04.652348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:04.653484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7eec0fc-c972-43f5-a793-bbe09bfaa10c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088111 Sep 01 07:36:04.654036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1286/2556] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:04 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:05.586930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:05.588124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:05.594602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:05.595097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:05.595541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:05.596234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:05.596694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:05.597143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:05.598235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:05.598845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:05.605205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:05.605680 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:05.606111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:05.606791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:05.607236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:05.607650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:05.790247 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:05.793245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:05.799060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-13a42788-8716-4d15-949a-5ec8749df28e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215990 Sep 01 07:36:05.799632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1271/2557] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:05.801297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37abfd94-fc2e-410d-a13e-6d1671a12690 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.206785 Sep 01 07:36:05.802003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1287/2558] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:05.804128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:05.804723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:05.810383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:05.810880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:05.811302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:05.811983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:05.812439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:05.812864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:05.874111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:05.882932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:05.884924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:05.886081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01c157cd-1138-4e78-8cc8-5b13333fb0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085545 Sep 01 07:36:05.886636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1272/2559] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:05 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:06.820447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:06.821052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:06.821273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:06.821891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:06.827554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:06.828031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:06.828221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:06.828462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:06.828705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:06.829157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:06.829271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:06.829607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:06.829843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:06.830028 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:06.830294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:06.830719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:07.018228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:07.022183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:07.026791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38af23ea-0a3f-4de6-9b61-862ece861299 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210132 Sep 01 07:36:07.027356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1288/2560] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:07.031051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c4c66d12-7d3a-4779-862f-b3a433fc64fb tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213523 Sep 01 07:36:07.031740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1273/2561] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:07.033179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:07.033870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:07.039744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:07.040366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:07.040793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:07.041498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:07.041967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:07.042387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:07.105222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:07.114855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:07.116490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:07.117830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8277850f-3c57-4117-92ee-04c5ea17bad8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.088449 Sep 01 07:36:07.118758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1289/2562] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:07 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:08.047338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:08.047955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:08.050859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:08.051466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:08.054364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:08.054857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:08.055304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:08.056692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:08.057235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:08.057669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:08.058370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:08.058842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:08.059272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:08.059946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:08.060383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:08.060794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:08.247539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:08.254392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:08.255656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-647e7914-34ad-4585-b5ff-49611a5f46b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212211 Sep 01 07:36:08.256425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1274/2563] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:08.260671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:08.261302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:08.267032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27612254-0514-49a0-afbb-f1260b33316d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.220009 Sep 01 07:36:08.267311 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:08.267803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:08.268367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1290/2564] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:08.268520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:08.274186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:08.275188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:08.275634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:08.338538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:08.347117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:08.348593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:08.349754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5a9e1bc5-d86f-4367-939d-8814abc9d0dd tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.092621 Sep 01 07:36:08.350318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1275/2565] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:08 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:09.276266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:09.276895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:09.283349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:09.283825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:09.284256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:09.284936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:09.285416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:09.285839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:09.287669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:09.288282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:09.295273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:09.295757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:09.296193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:09.296903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:09.297371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:09.297794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:09.476861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:09.480953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:09.485139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cc0dc3b-9ca5-41e8-8507-71725efb91a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212694 Sep 01 07:36:09.485710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1291/2566] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:09.489332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3c6927cf-d02b-4742-9682-059b3d54c3ea tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.205465 Sep 01 07:36:09.489963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1276/2567] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:09.490121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:09.490695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:09.496359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:09.496837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:09.497307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:09.497984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:09.498432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:09.498854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:09.502699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:09.560897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:09.569445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:09.570882 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:09.572043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-625ef8fe-a4a9-4c37-9f56-77924ed88412 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085426 Sep 01 07:36:09.572595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1292/2568] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:09 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:10.506291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:10.506911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:10.509842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:10.510450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:10.513376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:10.513876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:10.514317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:10.515011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:10.515728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:10.516165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:10.517293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:10.517766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:10.518191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:10.518865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:10.519302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:10.519712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:10.704029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:10.707113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:10.712357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18fbf73e-d92b-4e9b-a339-f3648565b129 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209899 Sep 01 07:36:10.712940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1277/2569] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:10.715921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9a43afa-09b7-4923-b22c-bacc8620a923 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209806 Sep 01 07:36:10.716690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1293/2570] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:10.717368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:10.717992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:10.723617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:10.724107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:10.724550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:10.725266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:10.725725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:10.726155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:10.786965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:10.796025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:10.797507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:10.798649 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c36e705a-4985-4d78-8b0b-2150636f8d20 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.084773 Sep 01 07:36:10.799208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1278/2571] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:10 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:11.734186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:11.734791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:11.735808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:11.736467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:11.742688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:11.742865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:11.743191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:11.743889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:11.744202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:11.744332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:11.744912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:11.745036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:11.745377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:11.745495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:11.745791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:11.745918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:11.939503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:11.942448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:11.948518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c209919-37d1-46ba-aa65-5bea897235b9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218137 Sep 01 07:36:11.949342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1294/2572] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:11.951578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4a007383-0006-47c4-a1a6-7ea95a8c8d58 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.219478 Sep 01 07:36:11.952300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1279/2573] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:11.953829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:11.954422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:11.960104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:11.960572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:11.960998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:11.961775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:11.962248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:11.962717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:12.029556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:12.037949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:12.039375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:12.040527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e2d5803-1f10-46b2-bea6-6b7f9154f28c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.090520 Sep 01 07:36:12.041071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1295/2574] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:11 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:12.969573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:12.970255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:12.971944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:12.972551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:12.976540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:12.977022 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:12.977503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:12.978230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:12.978683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:12.978870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:12.979111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:12.979355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:12.979786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:12.980463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:12.980906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:12.981363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:13.185503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:13.189361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:13.193703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c3a76d16-e4e7-40e1-9411-96aebd27d5d7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.228007 Sep 01 07:36:13.194265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1280/2575] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:13.197461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59080cb1-2ea0-4ff6-a4bc-fa76647e972c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.229264 Sep 01 07:36:13.198103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1296/2576] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:13.198891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:13.199492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:13.205421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:13.205903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:13.206333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:13.207014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:13.207459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:13.208124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:13.279360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:13.287826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:13.289281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:13.290908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6085aa0-3bf0-429e-b168-78da7e77b8ba tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.095249 Sep 01 07:36:13.291465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1281/2577] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:13 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:14.215055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:14.215686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:14.218483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:14.219095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:14.222674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:14.223146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:14.223571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:14.224710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:14.225357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:14.225481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:14.225836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:14.225970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:14.226265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:14.226942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:14.227389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:14.228401 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:14.231028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:14.417038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:14.425253 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6c56059b-367c-452e-be1b-9d4b924eb682 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210495 Sep 01 07:36:14.425808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1282/2578] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:14.427963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:14.431469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:14.432150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:14.436421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a519376-a8ba-414e-9e80-980bf1030adc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.225705 Sep 01 07:36:14.437412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1297/2579] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:14.438482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:14.439092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:14.439535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:14.440225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:14.440679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:14.441101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:14.501344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:14.512831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:14.514338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:14.515750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2cf259e6-8d0d-4880-a0bb-c9513f8a4e53 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087938 Sep 01 07:36:14.516324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1283/2580] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:14 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:15.445922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:15.447080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:15.453457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:15.453933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:15.454363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:15.455044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:15.455491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:15.455911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:15.457857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:15.458469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:15.465357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:15.466440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:15.466880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:15.467569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:15.468019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:15.468440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:15.898494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:15.902474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:15.907040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-77bd56f4-6dd8-4d98-82cb-f7774a8e1bd7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.465044 Sep 01 07:36:15.907603 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1298/2581] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:15.910696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-78ef712e-ebe5-4f50-bc20-e2193ef40517 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.456585 Sep 01 07:36:15.911438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1284/2582] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:15.912672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:15.913571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:15.919648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:15.920322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:15.920933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:15.921842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:15.922287 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:15.922706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:15.983228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:15.991744 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:15.993264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:15.994394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d551098-e7af-46d4-8b1b-21949f443e37 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085682 Sep 01 07:36:15.994946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1299/2583] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:15 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:16.928431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:16.929046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:16.931221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:16.931825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:16.935653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:16.935988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:16.936418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:16.937103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:16.937571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:16.937990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:16.938135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:16.938611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:16.939066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:16.939742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:16.940191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:16.940610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:17.128164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:17.129829 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:17.137245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca30e818-e8f6-4296-af9f-63bd43f69b6d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209724 Sep 01 07:36:17.137806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1300/2584] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:17.138475 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6142040e-e7b3-4b6b-ba0c-533666d5d3de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214005 Sep 01 07:36:17.145796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1285/2585] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:17.145976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:17.145976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:17.149246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:17.150349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:17.150775 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:17.151443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:17.151883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:17.152288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:17.212060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:17.221372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:17.222802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:17.223928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d4ab42c-64aa-45eb-bc45-03d40e359c23 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.085218 Sep 01 07:36:17.224480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1301/2586] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:17 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:18.159131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:18.159712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:18.160103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:18.160239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:18.167075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:18.167266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:18.167546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:18.167665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:18.167970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:18.168088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:18.168642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:18.168752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:18.169077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:18.169303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:18.169517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:18.169627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:18.364725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:18.369357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:18.372915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-99e01dbd-1338-4d1c-b565-155c8be0fe7c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217573 Sep 01 07:36:18.373505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1286/2587] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:18.377952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:18.378118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cc7390d-ed7b-479b-9b35-ea734cb24ba8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.222301 Sep 01 07:36:18.378549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:18.384581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:18.385063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:18.385514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:18.386017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1302/2588] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:18.386217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:18.386638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:18.387053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:18.450341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:18.458945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:18.460404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:18.461553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50977803-0f18-4125-88bc-832ba9bee163 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087147 Sep 01 07:36:18.462689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1287/2589] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:18 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:19.394664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:19.395214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:19.399948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:19.400690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:19.402234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:19.402710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:19.403131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:19.403805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:19.404247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:19.404656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:19.407026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:19.407507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:19.407938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:19.408621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:19.409070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:19.409514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:19.595533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:19.599380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:19.603640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c50f4f37-8c21-4fb8-9326-0e9ddead772f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208003 Sep 01 07:36:19.604343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1288/2590] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:19.607548 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75c13bcc-5d4d-49d8-92e3-f318a148a78b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217027 Sep 01 07:36:19.608094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1303/2591] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:19.608846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:19.609715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:19.615352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:19.615832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:19.616262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:19.616934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:19.617407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:19.617824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:19.677436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:19.686403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:19.687825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:19.688942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a4b7f547-23ce-4736-a8f3-96dc3ef3c145 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.083698 Sep 01 07:36:19.689518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1289/2592] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:19 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:20.625214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:20.625818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:20.628239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:20.628854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:20.633348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:20.634679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:20.635434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:20.635724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:20.636194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:20.636317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:20.636632 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:20.636828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:20.637406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:20.637613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:20.637862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:20.638294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:20.830788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:20.838085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:20.839747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fdd96175-6935-4864-8738-6b22dfa5895e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218408 Sep 01 07:36:20.840331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1304/2593] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:20.844750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:20.845378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:20.846383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f3fda618-bae8-4cdf-9f77-1be24a7f45fc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.221800 Sep 01 07:36:20.848242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1290/2594] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:20.851454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:20.851932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:20.852364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:20.853071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:20.853542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:20.853959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:20.919531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:20.928040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:20.929512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:20.931229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b44caa0-712e-46a8-89ca-411d68e288fc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089440 Sep 01 07:36:20.931772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1305/2595] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:20 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:21.860452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:21.861067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:21.867137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:21.867459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:21.867878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:21.868042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:21.868187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:21.868696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:21.869163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:21.869586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:21.874542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:21.875018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:21.875453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:21.876138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:21.876583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:21.877010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:22.057374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:22.060608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:22.065770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36215d95-0459-4745-86de-6cb32543fc5e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209161 Sep 01 07:36:22.066617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1291/2596] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:22.070032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34352369-1f8a-4c8b-b6a9-8d83ef1a0e87 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.206021 Sep 01 07:36:22.070714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1306/2597] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:22.070845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:22.071408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:22.077234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:22.077723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:22.078165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:22.078853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:22.079312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:22.079738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:22.139529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:22.148188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:22.149661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:22.150820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b327ac89-57c5-43e7-ade0-b138500be54f tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.083487 Sep 01 07:36:22.151376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1292/2598] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:22 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:23.086599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:23.087811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:23.091169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:23.091782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:23.094200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:23.094675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:23.095103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:23.095772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:23.096212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:23.096629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:23.098079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:23.098557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:23.098991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:23.099681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:23.100134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:23.100560 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:23.287674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:23.290821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:23.295836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36db60c5-a8a1-4c07-8f0b-ea5f0520a46f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213004 Sep 01 07:36:23.296484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1307/2599] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:23.299108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-68843ce0-7f13-47d2-bbdb-7f1db50ea9fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212240 Sep 01 07:36:23.299809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1293/2600] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:23.301332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:23.301988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:23.308160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:23.308770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:23.309241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:23.309977 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:23.310422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:23.310835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:23.374414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:23.376541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:23.384908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:23.386395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:23.387523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ca8ded0-45c4-47bd-8f6b-2a07cb58cafc tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089889 Sep 01 07:36:23.388071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1308/2601] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:23 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:24.316181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:24.316805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:24.319854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:24.320463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:24.323186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:24.323679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:24.324097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:24.324785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:24.325263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:24.325680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:24.327208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:24.327682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:24.328115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:24.328789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:24.329265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:24.329687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:24.519191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:24.523023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:24.527355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-701190d5-7961-423e-aeb4-6dc1387d6a79 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215102 Sep 01 07:36:24.527926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1294/2602] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:24 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:24.531109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8de0939d-5ba5-470e-b280-20df4d52c5fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214960 Sep 01 07:36:24.531821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1309/2603] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:24.532534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:24.533153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:24.539421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:24.540408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:24.541041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:24.541812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:24.542263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:24.542682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:24.605717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:24.614197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:24.615619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:24.616750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-478111d3-bfab-417b-9509-5104242615e2 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.087913 Sep 01 07:36:24.617324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1295/2604] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:24 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:25.549305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:25.549914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:25.551550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:25.552165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:25.556452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:25.556948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:25.557394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:25.558063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:25.558497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:25.558615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:25.558907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:25.559016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:25.559439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:25.560127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:25.560580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:25.561003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:25.743542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:25.750323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:25.751629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76bc80d8-21a9-4508-a932-0659fc98f64c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.206345 Sep 01 07:36:25.754190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1310/2605] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:25.756971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:25.757598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:25.760486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bad8ffd9-eb25-464d-9e21-e89fc4ed4c80 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212660 Sep 01 07:36:25.761064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1296/2606] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:25.763982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:25.764669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:25.765331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:25.766467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:25.767075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:25.767513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:25.832046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:25.840420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:25.841871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:25.843049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e77021d1-2048-45d4-9cc4-b028fc98029c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.089566 Sep 01 07:36:25.843606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1311/2607] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:25 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:26.772976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:26.773623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:26.780088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:26.780568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:26.781001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:26.781365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:26.781773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:26.781969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:26.782144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:26.782563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:26.788260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:26.788729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:26.789180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:26.790417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:26.790860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:26.791281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:26.971458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:26.975411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:26.979764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3d2ee32e-5f39-457f-953d-c8f35856af90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210569 Sep 01 07:36:26.980365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1297/2608] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:26.983846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51a603d4-1861-48c1-8f92-bd55ef4c0635 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.206194 Sep 01 07:36:26.984398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1312/2609] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:26.984784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:26.985404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:26.988043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=74 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:26.992618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:26.993641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:26.994088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:26.994774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:26.995224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:26.995646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:27.055235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:27.057900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:27.065547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:27.067033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:27.068183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-794d0006-3836-42e4-ac93-0101c6b74026 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 200 len: 1444 microversion: 2.20 time: 0.086902 Sep 01 07:36:27.068777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1298/2610] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:26 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:27.090889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf82b043-aeeb-430e-bdb7-9932a3e04eca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '.version_select at 0x7f78cf43e5e0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:27.095371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf82b043-aeeb-430e-bdb7-9932a3e04eca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [62262090-4289-4d14-bb49-b8ae47326739] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 07:36:28.001832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:28.002439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:28.008451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:28.009567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:28.009998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:28.010673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:28.011117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:28.011533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:28.104420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf82b043-aeeb-430e-bdb7-9932a3e04eca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [62262090-4289-4d14-bb49-b8ae47326739] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60050. Sep 01 07:36:28.125273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf82b043-aeeb-430e-bdb7-9932a3e04eca tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204319312" status: 204 len: 0 microversion: 2.20 time: 1.038166 Sep 01 07:36:28.125851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1313/2611] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Sep 1 07:36:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1204319312 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 07:36:28.130592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:28.131495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:28.138115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:28.138616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:28.139048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:28.139738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:28.140195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:28.140881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:28.141427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:28.150313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-257c7b1f-d36e-4033-8fb1-21aed356d804 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.152517 Sep 01 07:36:28.150894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1299/2612] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:28.290781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:28.301635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13b731b0-a661-4d0c-9751-f438880a4816 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.174685 Sep 01 07:36:28.302423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1314/2613] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:28.950064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9e39551a-37dc-4346-80e5-c44007987c2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Action: 'create', calling method: .version_select at 0x7f78cf39b3a0>, body: {"keypair": {"name": "tempest-keypair-1391427530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA7OqGTKu5rWn661jhao5Y4jhE3RKFqtWs6PRGoiDneRzn2HzipiG1qdF7qhi7+eRB3JldZL+0iYOomZKIUDS4OcdrYOH4kEXaxzp9/up8cVH5Qx/ZCyHAy+p1D1YDMZA=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:36:28.966063 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9e39551a-37dc-4346-80e5-c44007987c2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Getting quotas for project e2774daeaf2945eea5b6f33ad4ea2bdf. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:36:28.970245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9e39551a-37dc-4346-80e5-c44007987c2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Getting quotas for user 2096dd4d4b6f49fc8572a4bcd9689248 and project e2774daeaf2945eea5b6f33ad4ea2bdf. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:36:28.982594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e39551a-37dc-4346-80e5-c44007987c2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [4dc35b3c-cda5-46ad-9645-4520b89e87cc] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 07:36:29.172396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:29.172988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:29.179343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:29.179907 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:29.181146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:29.181854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:29.182427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:29.183018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:29.372579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:29.380686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d2ce28d3-46c8-4392-8958-ba1cf5fc8662 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212261 Sep 01 07:36:29.381278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1315/2614] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:29.386301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:29.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:29.393997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:29.394483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:29.395455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:29.395600 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:29.396035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:29.396450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:29.589501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:29.598501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fee03a13-6792-476a-854c-9444fc5bf11f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216241 Sep 01 07:36:29.599446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1316/2615] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:29.990261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e39551a-37dc-4346-80e5-c44007987c2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [4dc35b3c-cda5-46ad-9645-4520b89e87cc] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60070. Sep 01 07:36:30.004329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9e39551a-37dc-4346-80e5-c44007987c2c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.058799 Sep 01 07:36:30.004929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1300/2616] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Sep 1 07:36:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1060 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 07:36:30.403383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:30.405272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:30.423331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:30.423816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:30.424265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:30.424945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:30.426601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:30.426601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:30.619858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:30.620586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:30.628176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:30.628667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:30.629109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:30.629830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:30.630291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:30.630719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:30.656397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:30.665006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3555b50-bd87-4d3e-b6a0-aeca4c34e3a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.265983 Sep 01 07:36:30.677138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1317/2617] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:30.855903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:30.864328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-07f44b9f-3056-44e3-8439-1cf6380d966d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.248395 Sep 01 07:36:30.864907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1301/2618] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:31.424305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1582837206", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de2b3597-56ee-48e1-b75b-557a6c9a793f"}], "security_groups": [{"name": "tempest-securitygroup--1677104484"}], "key_name": "tempest-keypair-1391427530", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:36:31.525760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] validate_networks() for [('de2b3597-56ee-48e1-b75b-557a6c9a793f', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:36:31.686366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:31.686972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:31.693310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:31.693804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:31.694246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:31.694941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:31.695396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:31.695822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:31.909185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:31.917822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b2d5a6a2-97c0-42c8-849f-660ab695e165 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.235412 Sep 01 07:36:31.918399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1302/2619] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:31.922744 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:31.923345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:31.929364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:31.929960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:31.931155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:31.931967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:31.932420 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:31.932841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:32.060247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:36:32.060767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:36:32.061261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:36:32.061664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:36:32.062064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:36:32.064265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:32.073309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:32.073810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:32.074241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:32.074956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:32.075400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:32.075846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:32.089724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:32.092661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Getting quotas for project e2774daeaf2945eea5b6f33ad4ea2bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:36:32.096567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Getting quotas for user 2096dd4d4b6f49fc8572a4bcd9689248 and project e2774daeaf2945eea5b6f33ad4ea2bdf. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:36:32.097985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a198da40-936d-4d1e-8fdb-596be9e19b7b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.178648 Sep 01 07:36:32.098554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1303/2620] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:32.108103 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:36:32.110436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:36:32.156636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [020492df-8dc1-414f-9d10-45e46f047fb3] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 07:36:32.939459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:32.940107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:32.946669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:32.947154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:32.947594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:32.948283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:32.948739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:32.949190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:33.075336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:33.083571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c062180f-8e92-4c78-a50a-1e79823473c0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.147983 Sep 01 07:36:33.084142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1304/2621] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:33.118339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:33.118941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:33.124480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:33.124958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:33.125490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:33.126180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:33.126634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:33.127060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:33.165490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [020492df-8dc1-414f-9d10-45e46f047fb3] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60116. Sep 01 07:36:33.169736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb32e16b-18a1-4415-bbcf-1912215086ad tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.749878 Sep 01 07:36:33.171025 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1318/2622] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Sep 1 07:36:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 07:36:33.181393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7fc129d-3097-4db5-a431-233bd81c7cb9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:33.181998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7fc129d-3097-4db5-a431-233bd81c7cb9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:33.247587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7fc129d-3097-4db5-a431-233bd81c7cb9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:33.256564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7fc129d-3097-4db5-a431-233bd81c7cb9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:33.258130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7fc129d-3097-4db5-a431-233bd81c7cb9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:33.259834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7fc129d-3097-4db5-a431-233bd81c7cb9 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1282 microversion: 2.20 time: 0.082362 Sep 01 07:36:33.261154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1319/2623] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:33 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:36:33.294635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:33.302695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0cca2174-cced-4fc4-a8f2-801c6a69a2fb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.187791 Sep 01 07:36:33.303256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1305/2624] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:33 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:34.103543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:34.104147 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:34.110516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:34.110992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:34.111422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:34.112097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:34.112540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:34.112965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:34.239573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:34.247653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd48ea63-5275-448d-99fe-15fc0a92317c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.147891 Sep 01 07:36:34.248209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1320/2625] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:34.281923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:34.282529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:34.288846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:34.289367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:34.289830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:34.290504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:34.290945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:34.291359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:34.324175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:34.324782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:34.330754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:34.331224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:34.331652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:34.332327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:34.332767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:34.333216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:34.352805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:34.360726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:34.362180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:34.363308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-627f1e00-6b1d-4187-81b1-c4d58def8dc8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1334 microversion: 2.20 time: 0.085172 Sep 01 07:36:34.363899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1306/2626] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:34 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1334 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:34.464952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:34.474359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-01184f18-ca0e-4a0d-8165-7a8da0cc4753 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.154425 Sep 01 07:36:34.474929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1321/2627] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:35.268662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:35.269300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:35.275128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:35.275607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:35.276039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:35.276729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:35.277211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:35.277634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:35.385724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:35.386478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:35.393563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:35.394046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:35.394700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:35.395171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:35.395614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:35.396029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:35.587738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:35.595902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:35.597835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:35.598948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8804e283-eb1e-433f-a4aa-ce3f214e1e19 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1340 microversion: 2.20 time: 0.217820 Sep 01 07:36:35.599718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1322/2628] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:35 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1340 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 07:36:35.604694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:35.605338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:35.611351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:35.611832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:35.612265 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:35.612957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:35.613439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:35.613845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:35.766484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:35.775231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c4ce7434-df57-4951-8b03-e1de4bde632a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.510710 Sep 01 07:36:35.776039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1307/2629] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:35.858336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:35.867748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5c31dc1-6938-406e-9ab2-f20f5b9453c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.266886 Sep 01 07:36:35.882270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1323/2630] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:36.484399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-208ea0d1-3336-42f4-b848-af6d4576aae5 req-baba3b87-1238-45d0-bdda-cbfd9d208464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d2af7b-7f82-4fa4-8615-4ac5606b7c29", "tag": "5ef78fde-5aa9-4ebd-a8dc-9ea291c3c6b3"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:36:36.496887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-208ea0d1-3336-42f4-b848-af6d4576aae5 req-baba3b87-1238-45d0-bdda-cbfd9d208464 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:36.497396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-208ea0d1-3336-42f4-b848-af6d4576aae5 req-baba3b87-1238-45d0-bdda-cbfd9d208464 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:36.497822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-208ea0d1-3336-42f4-b848-af6d4576aae5 req-baba3b87-1238-45d0-bdda-cbfd9d208464 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:36.509721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-208ea0d1-3336-42f4-b848-af6d4576aae5 req-baba3b87-1238-45d0-bdda-cbfd9d208464 service nova] Creating event network-changed:5ef78fde-5aa9-4ebd-a8dc-9ea291c3c6b3 for instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 on hv-cinder-73306 Sep 01 07:36:36.515557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-208ea0d1-3336-42f4-b848-af6d4576aae5 req-baba3b87-1238-45d0-bdda-cbfd9d208464 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090169 Sep 01 07:36:36.516563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1308/2631] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:36:36.622389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:36.622985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:36.629800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:36.630279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:36.630712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:36.631390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:36.631826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:36.632306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:36.796494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:36.797323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:36.803460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:36.803956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:36.804398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:36.805090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:36.806077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:36.806511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:36.829305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:36.837483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:36.839013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:36.840198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5076604-af09-4b4c-965f-884dc3ec66b4 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1408 microversion: 2.20 time: 0.221848 Sep 01 07:36:36.840752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1324/2632] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:36 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:36.889988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:36.890942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:36.896825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:36.897388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:36.897750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:36.898424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:36.898917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:36.899345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:37.057170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:37.065638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-81a041b3-329a-4350-ab16-c111701db499 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.273359 Sep 01 07:36:37.066529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1309/2633] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:37.097196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:37.106007 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f4bb46b-74ec-4258-acfb-3a3d83e976fd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.219827 Sep 01 07:36:37.106581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1325/2634] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:37.861138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:37.861755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:37.864202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:36:37.864348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 (ip 10.222.0.46) !!! Sep 01 07:36:37.870826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:37.871305 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:37.871742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:37.872429 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:37.872912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:37.873363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:38.001962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:38.010445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:38.011884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:38.012975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4fd878ec-0efc-4da4-bece-175e5edd2764 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1408 microversion: 2.20 time: 0.155775 Sep 01 07:36:38.013571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1310/2635] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:37 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:38.086370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:38.086973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:38.093385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:38.093864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:38.094296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:38.094973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:38.095417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:38.095837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:38.129303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:38.130114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:38.137490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:38.138250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:38.138689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:38.139640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:38.140210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:38.140890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:38.314135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:38.322779 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e669bc0-13e4-4978-89af-73890cf6b7da tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.240285 Sep 01 07:36:38.323542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1326/2636] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:38.348531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:38.356832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7fd0f5bc-638b-4e57-b087-ac3fd8b4da2d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.232276 Sep 01 07:36:38.357445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1311/2637] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:39.035510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:39.036124 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:39.038277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:36:39.038412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 (ip 10.222.0.46) !!! Sep 01 07:36:39.044659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:39.045159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:39.045592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:39.046271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:39.046717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:39.047140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:39.179659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:39.188351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:39.189831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:39.190958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7f133bd-9809-4100-877f-ac655786783b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1408 microversion: 2.20 time: 0.159307 Sep 01 07:36:39.191517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1327/2638] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:39 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:39.343481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:39.344028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:39.346341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:39.351594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:39.352646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:39.353081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:39.353786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:39.354236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:39.354655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:39.378159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:39.378772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:39.384583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:39.385054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:39.385517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:39.386194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:39.386631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:39.387045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:39.391190 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:39.537403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:39.545942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc3b99a5-cd45-4522-a2b3-b720611cf073 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.206472 Sep 01 07:36:39.546523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1312/2639] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:39 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:39.558626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:39.566873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7200fd37-6e2e-4f8e-9dfd-1503efa5fc97 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.192492 Sep 01 07:36:39.567461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1328/2640] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:39 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:40.213597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:40.214229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:40.220341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:40.220844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:40.221320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:40.222025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:40.222481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:40.222907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:40.357444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:40.365683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:40.367108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:40.369672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-71f997ae-6f9a-4a89-b0f0-ba388c2e9a6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1408 microversion: 2.20 time: 0.159125 Sep 01 07:36:40.369672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1313/2641] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:40 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:40.567467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:40.568005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:40.574397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:40.574867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:40.575285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:40.575956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:40.576394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:40.576804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:40.588020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:40.588628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:40.594488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:40.594971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:40.595407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:40.596092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:40.596546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:40.596976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:40.771222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:40.778822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:40.780434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1a79a010-41b6-42d4-88ff-fe2e9e2339e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216871 Sep 01 07:36:40.781433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1329/2642] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:40.787007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce2d0210-3f4c-4215-b523-85e99bcf4424 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.203386 Sep 01 07:36:40.788031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1314/2643] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:41.391282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:41.391801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:41.398228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:41.399342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:41.399826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:41.401248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:41.401690 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:41.402101 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:41.527379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:41.535229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:41.536656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:41.537787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c7dbd31-f2d6-4886-84bd-5c3964c63811 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1408 microversion: 2.20 time: 0.151069 Sep 01 07:36:41.538347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1330/2644] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:41 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:41.801039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:41.801685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:41.808040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:41.808665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:41.808883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:41.809419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:41.809856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:41.810546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:41.810993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:41.811411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:41.814935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:41.815404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:41.815835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:41.816508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:41.816949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:41.817388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:42.005500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:42.008920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:42.014894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ba37f0c-f8d5-45a1-b80b-1a14b9675299 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217597 Sep 01 07:36:42.016060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1315/2645] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:42.032059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5944e34-0f20-4ed7-a6f9-73cb9369254a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.228261 Sep 01 07:36:42.032883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1331/2646] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:42.184290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-6952b38e-c0b9-4f85-802f-9be670f377fd req-4fa478ac-ed88-493a-8e99-8fa85df3ef93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d2af7b-7f82-4fa4-8615-4ac5606b7c29", "name": "network-vif-plugged", "status": "completed", "tag": "5ef78fde-5aa9-4ebd-a8dc-9ea291c3c6b3"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:36:42.193996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6952b38e-c0b9-4f85-802f-9be670f377fd req-4fa478ac-ed88-493a-8e99-8fa85df3ef93 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:42.194740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6952b38e-c0b9-4f85-802f-9be670f377fd req-4fa478ac-ed88-493a-8e99-8fa85df3ef93 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:42.195169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6952b38e-c0b9-4f85-802f-9be670f377fd req-4fa478ac-ed88-493a-8e99-8fa85df3ef93 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:42.206317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6952b38e-c0b9-4f85-802f-9be670f377fd req-4fa478ac-ed88-493a-8e99-8fa85df3ef93 service nova] Creating event network-vif-plugged:5ef78fde-5aa9-4ebd-a8dc-9ea291c3c6b3 for instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 on hv-cinder-73306 Sep 01 07:36:42.211217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-6952b38e-c0b9-4f85-802f-9be670f377fd req-4fa478ac-ed88-493a-8e99-8fa85df3ef93 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085718 Sep 01 07:36:42.212302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1316/2647] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:36:42.560472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:42.561106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:42.562945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:42.568329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:42.568809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:42.569307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:42.569990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:42.570467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:42.570888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:42.695235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:42.703203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:42.704647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:42.705786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0cd46833-0f72-4e73-a60d-13cb6578bcae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1408 microversion: 2.20 time: 0.149227 Sep 01 07:36:42.706345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1332/2648] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:42 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:43.037452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:43.038153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:43.044768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:43.045294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:43.045731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:43.046413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:43.048186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:43.048186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:43.053266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:43.053867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:43.060758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:43.061261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:43.061689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:43.062363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:43.062799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:43.063212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:43.240865 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:43.243787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:43.248468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:43.250878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4b554956-146a-4192-a785-b970067d2738 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218127 Sep 01 07:36:43.251456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1317/2649] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:43 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:43.254847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:43.258205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff7c6332-e556-4ac8-83c3-93eb880e3e4b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208663 Sep 01 07:36:43.258766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1333/2650] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:43 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:43.728462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:43.728989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:43.735171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:43.735656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:43.736089 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:43.736777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:43.737265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:43.737690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:43.861780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:43.869758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:43.871203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:43.872325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e7a2cd2d-31ff-4f8d-9489-dc4270dd2f49 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1408 microversion: 2.20 time: 0.148512 Sep 01 07:36:43.872883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1318/2651] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:43 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:44.271948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:44.272609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:44.279582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:44.280095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:44.280201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:44.280435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:44.280866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:44.281576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:44.282210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:44.282634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:44.286476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:44.286956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:44.287393 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:44.288077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:44.288531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:44.288954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:44.487019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:44.491125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:44.495447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-11b0ddae-7a5b-4d53-a473-a0a397df265b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.219586 Sep 01 07:36:44.496018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1319/2652] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:44.500027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d9abe2c2-4d43-470e-83e4-3380656623e2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.231952 Sep 01 07:36:44.504400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1334/2653] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:44.895099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:44.895706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:44.902059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:44.902544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:44.902990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:44.903672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:44.904125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:44.904552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:45.032349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:45.040837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:45.042310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:45.043453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f1468850-577b-4ea4-85d6-3f482327dd71 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1600 microversion: 2.20 time: 0.152578 Sep 01 07:36:45.044018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1320/2654] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:36:44 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:36:45.064781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:45.065300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:45.071476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:45.071606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:45.071980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:45.072701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:45.073169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:45.073586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:45.148323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c5017942-c6ea-4393-8a4c-c164d9270ff3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087363 Sep 01 07:36:45.149466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1335/2655] 10.222.0.46 () {60 vars in 1316 bytes} [Thu Sep 1 07:36:45 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:36:45.517439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:45.518049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:45.525015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:45.525536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:45.525976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:45.526675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:45.527133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:45.527561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:45.528272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:45.528972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:45.535316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:45.536003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:45.536516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:45.537332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:45.537857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:45.538350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:45.819915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:45.826471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:45.829058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9ffb799f-6a6b-48e3-9414-605aca66f4b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.315793 Sep 01 07:36:45.830064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1321/2656] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:45.848060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b80d1263-8665-4082-a757-dfe4a732af7c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.325219 Sep 01 07:36:45.848634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1336/2657] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:46.483930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-75020b51-01c0-4bec-8ad3-f6c82e1d76df req-22af8b28-6111-4576-9dcf-e15b044ef7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d2af7b-7f82-4fa4-8615-4ac5606b7c29", "tag": "5ef78fde-5aa9-4ebd-a8dc-9ea291c3c6b3"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:36:46.493411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-75020b51-01c0-4bec-8ad3-f6c82e1d76df req-22af8b28-6111-4576-9dcf-e15b044ef7e7 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:46.493884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-75020b51-01c0-4bec-8ad3-f6c82e1d76df req-22af8b28-6111-4576-9dcf-e15b044ef7e7 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:46.494312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-75020b51-01c0-4bec-8ad3-f6c82e1d76df req-22af8b28-6111-4576-9dcf-e15b044ef7e7 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:46.505019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-75020b51-01c0-4bec-8ad3-f6c82e1d76df req-22af8b28-6111-4576-9dcf-e15b044ef7e7 service nova] Creating event network-changed:5ef78fde-5aa9-4ebd-a8dc-9ea291c3c6b3 for instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 on hv-cinder-73306 Sep 01 07:36:46.509967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-75020b51-01c0-4bec-8ad3-f6c82e1d76df req-22af8b28-6111-4576-9dcf-e15b044ef7e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029601 Sep 01 07:36:46.510543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1322/2658] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:36:46.850182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:46.850794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:46.857995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:46.858480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:46.858914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:46.859663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:46.860109 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:46.860527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:46.873449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:46.875060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:46.884178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:46.885145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:46.885852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:46.886788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:46.887458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:46.888095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:47.157595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:47.163484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:47.167365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2900108c-530a-401d-a9cc-738cb969371c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.321192 Sep 01 07:36:47.174887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dae03b5f-7652-4c68-b70a-62c5761085e9 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.306082 Sep 01 07:36:47.181350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1337/2659] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:47.185268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1323/2660] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:48.188586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:48.189216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:48.196263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:48.196733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:48.197069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:48.197569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:48.197704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:48.197861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:48.198305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:48.198725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:48.204128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:48.204635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:48.205070 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:48.205817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:48.206271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:48.206697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:48.402737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:48.406079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:48.411021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7777be9-0aaa-4a50-a886-97376bbcd87c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.226268 Sep 01 07:36:48.411583 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1338/2661] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:48 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:48.415184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f6b19c32-4c7e-47fd-8ea0-1d4e7a913e76 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.221927 Sep 01 07:36:48.415778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1324/2662] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:48 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:49.432277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:49.432827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:49.436206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:49.436822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:49.439249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:49.439763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:49.440196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:49.440878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:49.441346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:49.441764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:49.443438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:49.443928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:49.444367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:49.445058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:49.445613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:49.446549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:49.631196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:49.635852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:49.639887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-834fb4d5-2f3d-4ac1-9821-0aef4e40419f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212002 Sep 01 07:36:49.640447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1339/2663] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:49.644325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca3bbc15-7d8c-4621-822e-b5d9864a2327 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212030 Sep 01 07:36:49.644940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1325/2664] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:50.660152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:50.661056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:50.665352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:50.665964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:50.667593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:50.668070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:50.668497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:50.669196 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:50.669649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:50.670064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:50.672208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:50.672683 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:50.673132 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:50.673812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:50.674263 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:50.674681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:50.850858 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:50.859013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28e15c0a-2cbc-448b-a3fd-98840453080d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.202707 Sep 01 07:36:50.859576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1340/2665] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:50.864021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:50.872117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dabc7b55-54cf-4e86-b8d4-da6696d24c38 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210832 Sep 01 07:36:50.872672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1326/2666] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:51.880405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:51.881006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:51.887456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:51.888096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:51.888353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:51.889058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:51.889533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:51.889976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:51.893229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:51.893876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:51.900545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:51.901020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:51.901481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:51.902162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:51.902610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:51.903028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:52.084209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:52.091159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:52.092962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-740edd82-6d4c-40b4-88cf-d3feff4079da tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216492 Sep 01 07:36:52.093747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1341/2667] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:52.099545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-aac4a534-b986-4c40-9f66-95e0b8f4dd41 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210394 Sep 01 07:36:52.100096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1327/2668] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:53.112726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:53.113346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:53.120158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:53.120663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:53.120781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:53.120942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:53.121395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:53.122066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:53.122509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:53.122918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:53.127064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:53.127539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:53.127969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:53.128650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:53.129097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:53.129540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:53.315115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:53.319301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:53.323282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ca1c9fd-6a5b-4857-a4a3-c8b19f33a533 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214389 Sep 01 07:36:53.323847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1342/2669] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:53.327546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1eb7552f-408a-48e1-9953-6a20c4d6859c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211647 Sep 01 07:36:53.328041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1328/2670] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:54.344986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:54.345609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:54.347704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:54.348319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:54.352067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:54.352537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:54.352961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:54.353658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:54.354096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:54.354507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:54.354657 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:54.355045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:54.355481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:54.356166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:54.356622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:54.357057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:54.547167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:54.551452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:54.556076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9605b78c-a9a5-45ee-82a7-3c8dd6cd9027 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214959 Sep 01 07:36:54.556855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1343/2671] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:54 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:54.560922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-55c302aa-be23-4381-a8a8-82edd1fee023 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217046 Sep 01 07:36:54.561511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1329/2672] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:54 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:55.578162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:55.578825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:55.580827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:55.581527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:55.585378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:55.585854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:55.586353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:55.587042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:55.587493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:55.587831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:55.587955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:55.588404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:55.588941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:55.589688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:55.590239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:55.590618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:55.780553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:55.783929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:55.788902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0b16270-1879-4f8a-9a5d-eeef136613e5 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214846 Sep 01 07:36:55.790065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1344/2673] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:55.792767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dbf6fa90-75c7-4302-aeab-f8b149d31daa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215717 Sep 01 07:36:55.793397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1330/2674] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:56.810484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:56.811093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:56.814021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:56.814768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:56.817536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:56.818017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:56.818449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:56.819128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:56.819575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:56.819993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:56.821622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:56.822100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:56.822529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:56.823219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:56.823661 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:56.824078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:56.824605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:57.016417 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:57.020515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:57.024762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e34fcec-ddb8-4f81-8a2f-b667cd2321cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218090 Sep 01 07:36:57.025358 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1345/2675] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:57.028761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-49e86735-359e-4e92-b632-2eb4be05bc71 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218591 Sep 01 07:36:57.029450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1331/2676] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:58.044539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:58.045164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:58.049346 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:58.049962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:58.051621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:58.052017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:36:58.052138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:58.052514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:58.053228 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:58.053704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:58.054121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:58.057223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:58.057706 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:58.058143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:58.058856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:58.059310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:58.059726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:58.244090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:58.251383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:58.252441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8273fc63-d01d-4be4-98f1-39a8eb048383 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211669 Sep 01 07:36:58.253019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1346/2677] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:58.260282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0deca799-2bb1-4ac3-accd-b9cbab5feeab tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214952 Sep 01 07:36:58.261111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1332/2678] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:36:59.275209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:59.275903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:59.280946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:36:59.281617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:36:59.281848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:59.282319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:59.282745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:59.283415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:59.283847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:59.284256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:59.287921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:59.288406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:59.288849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:59.290207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:36:59.290664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:36:59.291100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:36:59.468469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:59.477535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7765f54-ea35-4c61-9a68-10bcadf4a986 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.205982 Sep 01 07:36:59.478123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1347/2679] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:59 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:36:59.479882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:36:59.488068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b9dad563-eee0-44b6-83d2-a3f40d99b41c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210953 Sep 01 07:36:59.488626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1333/2680] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:36:59 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:00.498913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:00.499510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:00.506075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:00.506545 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:00.506970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:00.507558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:00.507973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:00.508082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:00.508189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:00.508460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:00.514390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:00.514871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:00.515319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:00.516258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:00.516711 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:00.517161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:00.698301 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:00.701389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:00.706501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b929317-4250-477b-95e9-6b40eeb0ffdd tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211439 Sep 01 07:37:00.707066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1348/2681] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:00.709603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ce1d8c37-e1a9-418a-a9a9-a64704cec220 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.205887 Sep 01 07:37:00.710162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1334/2682] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:01.727695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:01.728300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:01.730485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:01.731105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:01.734717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:01.735199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:01.735630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:01.736306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:01.736751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:01.737195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:01.737309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:01.737777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:01.738217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:01.738903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:01.739535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:01.739970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:01.744369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:01.932675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:01.936704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:01.940877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c8990c5-4f68-45a9-a4cb-41cde61b0aaa tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214111 Sep 01 07:37:01.941473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1335/2683] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:01.945051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-882d6015-65b0-4b28-95f8-d5f85c29ccfe tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.221186 Sep 01 07:37:01.945784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1349/2684] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:02.961332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:02.961949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:02.965330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:02.965940 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:02.968198 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:02.968328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:02.968774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:02.969312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:02.969998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:02.970443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:02.970861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:02.973578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:02.974057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:02.974494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:02.975177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:02.975628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:02.976048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:03.162426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:03.166291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:03.170587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8decafd9-88a5-48b9-bea5-b84c18c6ea02 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213117 Sep 01 07:37:03.171151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1336/2685] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:03.174394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e4bfd9d-f8c8-48bc-934c-4a9f315b90c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212879 Sep 01 07:37:03.175114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1350/2686] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:04.191836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:04.192449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:04.195463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:04.196070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:04.200391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:04.200890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:04.201357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:04.202071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:04.202538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:04.202672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:04.203062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:04.203200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:04.203504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:04.204186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:04.204636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:04.205059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:04.388724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:04.396761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:04.397156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0e5fe92e-63ef-4c87-9e7e-2050b77c78eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.205437 Sep 01 07:37:04.397720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1351/2687] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:04 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:04.405660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7d750921-967e-4eb8-a3e7-2e916964eb08 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217637 Sep 01 07:37:04.406208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1337/2688] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:04 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:05.418559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:05.419137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:05.425832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:05.426315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:05.426753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:05.426918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:05.427360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:05.427469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:05.427872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:05.428294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:05.434255 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:05.434768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:05.435208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:05.435898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:05.436349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:05.436805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:05.610084 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:05.618766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9dc95909-d132-42df-b1d6-2c3c7845eb05 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.204136 Sep 01 07:37:05.619330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1352/2689] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:05.631461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:05.640114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a98b105-8b9f-4bb0-8460-7903d8e09f01 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217337 Sep 01 07:37:05.640671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1338/2690] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:06.639570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:06.640170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:06.646852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:06.647328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:06.647759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:06.648440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:06.649432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:06.649850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:06.661323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:06.661941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:06.668824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:06.669347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:06.669800 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:06.670490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:06.670946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:06.671373 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:06.838271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:06.846394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1378bcd9-733a-4954-8ea3-d4e616cd841a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210653 Sep 01 07:37:06.846963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1353/2691] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:06.849104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:06.858104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e2b0f0e-8e9e-4daa-993d-71a2d218f03d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.200604 Sep 01 07:37:06.858746 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1339/2692] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:07.867276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:07.868476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:07.875045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:07.875524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:07.875954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:07.876635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:07.877077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:07.877531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:07.878518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:07.879129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:07.885368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:07.885843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:07.886271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:07.886951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:07.887392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:07.887808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:08.067939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:08.071197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:08.076378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ee364cd-ec58-44d5-bc30-4ef87b821c3c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213049 Sep 01 07:37:08.077141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1354/2693] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:08.079383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b743a5f8-73e1-4c3a-980a-2d1982724158 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.204577 Sep 01 07:37:08.079943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1340/2694] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:09.097566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:09.098199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:09.099512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:09.100260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:09.104711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:09.105212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:09.105641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:09.106321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:09.106506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:09.106761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:09.106989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:09.107173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:09.107424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:09.108111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:09.108563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:09.108985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:09.301329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:09.305714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:09.310128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e430276-a77a-43c2-899c-0c245676d42a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216546 Sep 01 07:37:09.310693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1355/2695] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:09.313888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-95f312b0-c7a0-4a80-b5b4-405ae0d412b5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218131 Sep 01 07:37:09.314447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1341/2696] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:10.329829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:10.330366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:10.334020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:10.334665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:10.336734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:10.337241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:10.337667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:10.338366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:10.338803 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:10.339214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:10.340792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:10.341298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:10.341733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:10.342419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:10.342872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:10.343314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:10.786155 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:10.790209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:10.794316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7a34031f-f2ff-4505-82bb-c65468bf17a1 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.468339 Sep 01 07:37:10.794881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1356/2697] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:10 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:10.798603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a665d521-36c5-4326-8d0e-78a69562ee40 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.468446 Sep 01 07:37:10.799155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1342/2698] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:10 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:11.815877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:11.816475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:11.818037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:11.818650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:11.822980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:11.823450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:11.823880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:11.824553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:11.824988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:11.825128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:11.825429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:11.825544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:11.825920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:11.826601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:11.827046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:11.827461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:12.016327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:12.020547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:12.025065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5e033c8-7978-45ac-b7ce-8db060e998ca tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212999 Sep 01 07:37:12.025734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1357/2699] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:12.029455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5a61024-5640-4d66-af58-40eff45cb77c tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215067 Sep 01 07:37:12.030021 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1343/2700] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:13.046449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:13.047089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:13.050834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:13.051453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:13.053546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:13.054027 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:13.054850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:13.055222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:13.056168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:13.056590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:13.058463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:13.058951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:13.059392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:13.060085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:13.060544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:13.060974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:13.247825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:13.250931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:13.256063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96527f31-8fb6-4d17-87a2-117f539a16cc tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213507 Sep 01 07:37:13.256713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1358/2701] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:13.259316 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0d9215bd-7eec-498b-b361-50c35fce64de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212367 Sep 01 07:37:13.259883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1344/2702] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:14.277507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:14.278123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:14.279499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:14.280120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:14.284593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:14.285062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:14.285544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:14.286216 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:14.286374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:14.286656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:14.286858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:14.287066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:14.287296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:14.287982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:14.288434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:14.288861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:14.480464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:14.483644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:14.488612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fca67e14-040a-4506-9df7-d94928343ab3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215070 Sep 01 07:37:14.489452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1359/2703] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:14 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:14.492380 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cc2480b1-3056-492f-9a8f-3d4a987f48b7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216642 Sep 01 07:37:14.493516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1345/2704] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:14 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:15.510782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:15.511400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:15.514269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:15.514891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:15.518003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:15.518486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:15.518917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:15.519596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:15.520046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:15.520463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:15.521514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:15.522002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:15.522450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:15.523142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:15.523595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:15.524612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:15.713017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:15.717221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:15.721199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8c7664d-7f2e-4903-a2b9-8002e3f57a2f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214903 Sep 01 07:37:15.721768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1360/2705] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:15.725367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-84f953ad-5e27-4c40-b240-488de07c3a17 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214843 Sep 01 07:37:15.725926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1346/2706] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:16.742351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:16.743050 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:16.745462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:16.746076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:16.749482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:16.749948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:16.750372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:16.751067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:16.751512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:16.751924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:16.752331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:16.752827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:16.753363 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:16.754055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:16.754511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:16.754984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:16.943186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:16.945479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:16.947907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:16.953311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-114e0559-669c-4ebb-884f-0084b704efee tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214749 Sep 01 07:37:16.953893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1361/2707] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:16.956197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c19db18-2e56-40f4-89fd-f95a6b476b31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214447 Sep 01 07:37:16.956752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1347/2708] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:17.974806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:17.975372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:17.976956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:17.978105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:17.982484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:17.982963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:17.983393 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:17.984068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:17.984513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:17.984633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:17.984930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:17.985044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:17.985453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:17.986150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:17.986607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:17.987033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:18.178651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:18.181936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:18.186982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0270ff33-3d8c-481b-9e99-fa63c41b55e6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213810 Sep 01 07:37:18.187558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1348/2709] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:18.190289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b439236-6ed0-4435-97fc-ad52ef50eb52 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.219383 Sep 01 07:37:18.190834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1362/2710] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:19.207830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:19.208414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:19.210677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:19.211355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:19.215133 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:19.215625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:19.216066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:19.216763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:19.217286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:19.217705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:19.217836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:19.218172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:19.218595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:19.219266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:19.219703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:19.220116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:19.408198 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:19.415392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:19.417310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d4a7834-e00f-441d-b4b2-65e949c48216 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213249 Sep 01 07:37:19.418306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1349/2711] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:19 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:19.424547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b20599e-d2ca-4a40-a3f2-3082ae1a92f9 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217611 Sep 01 07:37:19.425143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1363/2712] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:19 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:20.440673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:20.441945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:20.445302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:20.445941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:20.449031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:20.449547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:20.449979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:20.450666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:20.451112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:20.451566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:20.453014 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:20.453517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:20.453948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:20.454632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:20.455108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:20.455535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:20.648860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:20.652088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:20.657236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3db63ffa-9d0e-4cf3-82b6-67f7a84314a3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215819 Sep 01 07:37:20.657807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1364/2713] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:20.660191 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e1c0d8ee-2468-4bd9-9a54-73fe85d50eb5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.223460 Sep 01 07:37:20.660754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1350/2714] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:21.681932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:21.682543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:21.688842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:21.689348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:21.689781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:21.690453 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:21.690896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:21.691311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:21.735490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:21.736079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:21.742536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:21.743017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:21.743446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:21.744626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:21.745075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:21.745533 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:21.856157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:21.864665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-41269156-1add-4744-9ae8-fc81bd815300 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.187025 Sep 01 07:37:21.865256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1365/2715] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:21.903064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:21.905283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:21.912177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-18ec0e1b-7077-46d5-be2b-99e3ded0d302 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.180552 Sep 01 07:37:21.912735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1351/2716] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:22.621297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:22.621784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:22.627686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:22.628161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:22.628591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:22.629291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:22.629741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:22.630162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:22.653281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dafcc63c-0b1a-40f9-a59d-baff8aacb500 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29/ips" status: 200 len: 151 microversion: 2.20 time: 0.036371 Sep 01 07:37:22.653866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1366/2717] 10.222.0.46 () {60 vars in 1289 bytes} [Thu Sep 1 07:37:22 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 07:37:22.886317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:22.886863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:22.893579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:22.894056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:22.894492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:22.895159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:22.895602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:22.896017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:22.933459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:22.934134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:22.940384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:22.940869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:22.941335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:22.942012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:22.942452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:22.942867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:23.069998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:23.078150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8134dabf-f345-4858-9217-f8e183e2ee99 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.195799 Sep 01 07:37:23.078723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1352/2718] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:23.096424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:23.105726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e0cd921a-c9b6-442d-a57c-f3007dc1b65a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.176684 Sep 01 07:37:23.106274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1367/2719] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:24.100756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:24.101397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:24.110383 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:24.110873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:24.111619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:24.112676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:24.113162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:24.113663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:24.126294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:24.126921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:24.133290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:24.133762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:24.134189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:24.134857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:24.135297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:24.135711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:24.305896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:24.314518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-613077f6-9dcf-44ac-bbdd-65c953a4d3cd tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217247 Sep 01 07:37:24.315959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1353/2720] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:24 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:24.317333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:24.326081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-336dec2d-20fe-4656-9204-60f64fab8719 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.203568 Sep 01 07:37:24.326718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1368/2721] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:25.335747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:25.336362 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:25.343273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:25.343703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:25.344140 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:25.344825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:25.345309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:25.345734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:25.346559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:25.347162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:25.354201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:25.354674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:25.355105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:25.355780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:25.356220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:25.356631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:25.531957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:25.540229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bfabc7e9-078a-4b3a-a3cb-3edd89aaca92 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208287 Sep 01 07:37:25.541498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1354/2722] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:25.554538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:25.562614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-33ecf028-bb72-499d-a9b8-c9e6ca64b4bf tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.219862 Sep 01 07:37:25.563168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1369/2723] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:25 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:26.562092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:26.562687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:26.569196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:26.569685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:26.570127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:26.570817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:26.571299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:26.571726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:26.583504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:26.584104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:26.590352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:26.590825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:26.591252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:26.591924 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:26.592364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:26.592777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:26.767208 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:26.771197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:26.775546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9309ef2-773f-460b-96ce-98cac03dc3bc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217336 Sep 01 07:37:26.776122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1355/2724] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:26.779361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-895645b4-db1d-4b11-9d7d-84ca6ad91f09 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.199632 Sep 01 07:37:26.779910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1370/2725] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:27.796787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:27.797428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:27.801206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:27.801823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:27.803992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:27.804481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:27.804923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:27.805725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:27.806183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:27.806605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:27.808238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:27.808721 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:27.809188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:27.810439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:27.810439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:27.810741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:27.994242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:27.998402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:28.002433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-515efb2c-72e2-437c-a332-aa3706909dff tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210007 Sep 01 07:37:28.003007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1356/2726] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:28.006750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b839c6e-d802-431b-9e7d-532fe9b40c9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209388 Sep 01 07:37:28.007303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1371/2727] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:29.024230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:29.024849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:29.027218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=50 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:29.027748 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:29.028363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:29.032423 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:29.032916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:29.033381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:29.034077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:29.034203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:29.034530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:29.034652 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:29.034958 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:29.035071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:29.035696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:29.036135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:29.036547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:29.226462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:29.231386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:29.237384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-086b2f9a-43a8-48f1-9fad-93bb64949adc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216970 Sep 01 07:37:29.237984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1357/2728] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:29 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:29.239450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c0fb2723-b7e2-49e0-9be4-2ed35f3b9c4a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215730 Sep 01 07:37:29.239993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1372/2729] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:29 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:30.259952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:30.260641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:30.268315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:30.268797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:30.269258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:30.269966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:30.270805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:30.270805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:30.326660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:30.327272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:30.333108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:30.333648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:30.334080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:30.334770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:30.335220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:30.335639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:30.547948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:30.556246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20e34356-bef2-459f-8250-4731123cbc34 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.300122 Sep 01 07:37:30.556819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1373/2730] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:30.559211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:30.567461 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47ff662f-e481-413e-9d2c-b7d60b7710ae tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.311386 Sep 01 07:37:30.568110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1358/2731] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:31.581167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:31.581730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:31.587496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:31.588093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:31.588227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:31.588574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:31.589009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:31.589717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:31.590166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:31.590586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:31.594452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:31.594940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:31.595386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:31.596080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:31.596538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:31.596966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:31.779642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:31.786694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:31.788255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dbffff23-3ee2-413a-b2d9-ef95dcb94a81 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211015 Sep 01 07:37:31.788823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1374/2732] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:31 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:31.795443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-36c8a774-4886-423a-bf56-398d630f1acc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211704 Sep 01 07:37:31.795988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1359/2733] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:31 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:32.810163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:32.810801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:32.816619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:32.817248 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:32.817474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:32.817728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:32.818165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:32.818855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:32.819291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:32.819708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:32.823542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:32.824621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:32.825064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:32.825796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:32.826251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:32.826682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:33.005941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:33.009873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:33.014827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1907276-4b3c-4855-9fbf-ea5e710d5473 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209017 Sep 01 07:37:33.015392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1375/2734] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:32 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:33.018830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba04348f-5ba1-4f5c-82a5-280b9c3b368f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.205977 Sep 01 07:37:33.019361 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1360/2735] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:32 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:34.035896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:34.036518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:34.038870 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=52 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:34.039019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:34.039514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:34.044373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:34.044859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:34.045334 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:34.046026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:34.046153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:34.046477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:34.046618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:34.046933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:34.047079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:34.047654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:34.048109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:34.048538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:34.236653 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:34.243510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:34.244784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08fa9218-f957-4d0a-8d3b-1efaf892368e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212888 Sep 01 07:37:34.245380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1376/2736] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:34 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:34.252060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59f80a99-149c-4fc6-aae3-1af1186cc876 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216988 Sep 01 07:37:34.252619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1361/2737] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:34 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:35.266783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:35.267390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:35.272947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:35.273583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:35.273802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:35.274277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:35.274705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:35.275382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:35.275823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:35.276240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:35.279813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:35.280297 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:35.280732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:35.281446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:35.281903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:35.282330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:35.465880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:35.469871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:35.474060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e6b4436-13bc-4d04-885c-3d86d220b725 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211330 Sep 01 07:37:35.474621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1377/2738] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:35 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:35.477916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ed300a21-83cd-4aa1-a450-c1fc63f9c8f7 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208904 Sep 01 07:37:35.478480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1362/2739] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:35 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:36.499774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:36.500382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:36.502308 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:36.502942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:36.506729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:36.507199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:36.507625 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:36.508299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:36.508738 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:36.509172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:36.509300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:36.509666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:36.510097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:36.510780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:36.511228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:36.511652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:36.697819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:36.700595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:36.702516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:36.707965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91b02bfe-cdf9-485e-b2e0-40375a9a1cc8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212556 Sep 01 07:37:36.708546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1378/2740] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:36 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:36.710693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8066c80-b428-4c0c-8def-42af51089839 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212193 Sep 01 07:37:36.711252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1363/2741] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:36 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:37.729013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:37.729673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:37.730836 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:37.731595 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:37.736235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:37.736713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:37.737158 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:37.737831 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:37.737946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:37.738270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:37.738412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:37.738747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:37.738874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:37.739541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:37.739996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:37.740419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:37.921802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:37.930513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6f1ec2bb-e506-41d9-93bc-1a46be4c5eb8 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.205074 Sep 01 07:37:37.930700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1379/2742] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:37 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:37.932731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:37.941516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-98fe27de-5719-4c9e-9977-28c28b9a6722 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214401 Sep 01 07:37:37.942072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1364/2743] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:37 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:38.951497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:38.952117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:38.958602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:38.959081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:38.959517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:38.960200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:38.960647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:38.961068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:38.961840 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:38.962453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:38.969326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:38.969806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:38.970242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:38.970920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:38.971366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:38.971782 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:39.152359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:39.157398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:39.161085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11205974-6c9b-4440-b277-eeb458cf2d9e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213464 Sep 01 07:37:39.161674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1380/2744] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:38 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:39.165552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9d7bce2a-0cab-4237-ab87-0ccc6313ddb8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.207436 Sep 01 07:37:39.166107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1365/2745] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:38 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:40.181899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:40.182536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:40.186211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:40.186980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:40.189626 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:40.190107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:40.190534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:40.191234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:40.191670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:40.192118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:40.196001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:40.196497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:40.196937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:40.197664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:40.198120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:40.198553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:40.382599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:40.386676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:40.390891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b8b2b04-91a7-45fc-ac93-bd0186812c04 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212766 Sep 01 07:37:40.391735 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1381/2746] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:40 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:40.395495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d27d321e-0d40-4868-af2f-e34a2690de0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213721 Sep 01 07:37:40.396136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1366/2747] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:40 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:41.412768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:41.413427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:41.416784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:41.417416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:41.419717 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:41.420733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:41.421185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:41.421857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:41.422294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:41.422703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:41.424454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:41.424942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:41.425431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:41.426119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:41.426571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:41.427025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:41.855519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:41.866585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7631202d-52fd-451e-a5a1-bebc7926a37b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.457756 Sep 01 07:37:41.867177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1382/2748] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:41 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:41.868350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:41.876698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2396806d-8386-450c-8f7c-f6823807ef03 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.463655 Sep 01 07:37:41.877651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1367/2749] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:41 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:42.886802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:42.887407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:42.894165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:42.894644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:42.895080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:42.895754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:42.896205 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:42.896622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:42.897733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:42.898354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:42.904625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:42.905109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:42.905579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:42.906272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:42.906728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:42.907156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:42.922536 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:43.088985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:43.091821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:43.097238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0b6b314-1f87-43b4-b3c7-d83a4819d17f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214334 Sep 01 07:37:43.097806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1383/2750] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:42 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:43.100010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-651437a2-235d-4500-898b-e6c71feaf912 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.206102 Sep 01 07:37:43.100732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1368/2751] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:42 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:44.118925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:44.119544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:44.120027 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:44.120640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:44.126419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:44.126887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:44.127316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:44.127767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:44.127987 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:44.128250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:44.128425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:44.128685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:44.128834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:44.129425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:44.129901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:44.130324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:44.323813 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:44.327679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:44.332841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c78b8963-eb5e-4755-8b97-c6a0e02a47a0 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216640 Sep 01 07:37:44.333531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1369/2752] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:44 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:44.335777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-237893fe-476b-41d8-8bdd-d2aca4fee163 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220724 Sep 01 07:37:44.336330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1384/2753] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:44 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:45.353583 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:45.354127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:45.356241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:45.356880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:45.360996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:45.361708 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:45.362146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:45.362858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:45.363306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:45.363728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:45.363867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:45.364207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:45.364638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:45.365345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:45.365791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:45.366394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:45.566324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:45.569631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:45.574435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0fd1aa9e-e464-40a9-9a38-c405cc3ecf6b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.224838 Sep 01 07:37:45.575109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1370/2754] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:45 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:45.578339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b12a9ff-fdb1-40d8-8def-e9b0f7840593 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.225876 Sep 01 07:37:45.578898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1385/2755] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:45 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:46.596244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:46.596866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:46.599062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:46.599766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:46.603293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:46.603780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:46.604227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:46.604923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:46.605407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:46.605837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:46.606030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:46.606507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:46.606936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:46.608130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:46.608576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:46.608993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:46.797289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:46.802218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:46.806638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-21627a37-ac43-4cef-987e-8566998d3e8a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214309 Sep 01 07:37:46.807434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1371/2756] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:46 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:46.809865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c1c0b279-a284-4857-afee-63e6617b728a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214522 Sep 01 07:37:46.810425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1386/2757] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:46 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:47.830960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:47.831529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:47.831924 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:47.832042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:47.838250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:47.838733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:47.838902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:47.839167 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:47.839384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:47.839821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:47.839960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:47.840314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:47.840536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:47.840733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:47.840988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:47.841446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:48.033108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:48.036286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:48.041271 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-30f825cc-a7d0-4772-ac8e-e60abff6128c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213851 Sep 01 07:37:48.041844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1387/2758] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:47 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:48.044435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5fab27ca-1ffc-47b8-b377-73c3a92e6a90 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.217904 Sep 01 07:37:48.045023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1372/2759] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:47 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:49.062903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:49.063513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:49.064412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:49.065028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:49.069994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:49.070465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:49.070894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:49.071331 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:49.071578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:49.071821 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:49.072020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:49.072261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:49.072434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:49.072949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:49.073446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:49.073874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:49.256588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:49.264671 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f751fc9c-0b10-4942-8402-89807010468e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.206281 Sep 01 07:37:49.265255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1388/2760] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:49 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:49.271075 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:49.279758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b79e63f7-f059-45b9-b70b-c1f212689f75 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.219177 Sep 01 07:37:49.280309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1373/2761] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:49 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:50.286613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:50.287187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:50.293473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:50.293943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:50.294367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:50.295711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:50.296097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:50.296513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:50.300675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:50.301317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:50.307662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:50.308148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:50.308584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:50.309307 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:50.309763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:50.310189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:50.487044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:50.493919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:50.495398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0abdd30-df36-4561-85ee-ea6b3c373958 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212790 Sep 01 07:37:50.495962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1389/2762] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:50 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:50.502096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f87cb37b-d6ef-4a03-baf4-4ed824d3bdf8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.205219 Sep 01 07:37:50.502656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1374/2763] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:50 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:51.517654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:51.518210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:51.523014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:51.523623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:51.524525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:51.524999 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:51.525464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:51.526146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:51.526590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:51.527049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:51.530261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:51.530740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:51.531172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:51.531855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:51.532302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:51.532755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:51.719884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:51.723769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:51.728499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ab8ee15-2ce1-4241-9eef-660acd03f54d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209341 Sep 01 07:37:51.729064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1375/2764] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:51 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:51.731937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cba1bbf7-6451-486d-87d1-103db6183e14 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.219210 Sep 01 07:37:51.732666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1390/2765] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:51 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:52.749963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:52.750557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:52.752836 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:52.753470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:52.757180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:52.757670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:52.758099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:52.758790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:52.759238 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:52.759658 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:52.760073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:52.760551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:52.760984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:52.761713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:52.762169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:52.762643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:52.950286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:52.954332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:52.958681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-344686ec-b506-4a28-bd90-3933303e3001 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.213300 Sep 01 07:37:52.959272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1376/2766] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:52 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:52.962465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-26bc21d0-1c64-4d82-ab36-19157a67c6fa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213369 Sep 01 07:37:52.963020 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1391/2767] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:52 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:53.978985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:53.979599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:53.983337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:53.983945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:53.986102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:53.986591 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:53.987341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:53.987720 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:53.988172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:53.988599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:53.990272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:53.990751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:53.991188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:53.991874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:53.992322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:53.992745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:54.181381 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:54.188250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:54.190078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-381a7fc0-12b9-4507-8f3f-456ada89f900 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215022 Sep 01 07:37:54.190659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1377/2768] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:53 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:54.196419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8322e69-47fa-4357-a832-70b5ba6561a4 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.216981 Sep 01 07:37:54.197141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1392/2769] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:53 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:55.210809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:55.211449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:55.217517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:55.218127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:55.218586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:55.219068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:55.219499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:55.220186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:55.220634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:55.221055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:55.224106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:55.224578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:55.225048 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:55.225750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:55.226199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:55.226617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:55.408028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:55.411485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:55.416282 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e5b520c2-a74d-4b3e-a0fb-9447856ee25e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209291 Sep 01 07:37:55.416966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1378/2770] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:55 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:55.419607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-262c3d7b-12ff-4c77-b257-aa29f2db401e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.206357 Sep 01 07:37:55.420789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1393/2771] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:55 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:56.438055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:56.438684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:56.441758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:56.442369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:56.445045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:56.445565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:56.446005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:56.446701 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:56.447156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:56.447581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:56.449057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:56.449556 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:56.449986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:56.450658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:56.451102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:56.451514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:56.639358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:56.643512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:56.648006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-050058ca-e7f7-4ac4-939f-b0eca2a7fee8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214894 Sep 01 07:37:56.648580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1379/2772] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:56 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:56.651704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3a1b2fa0-dff7-4692-9fe3-282aaaf92463 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213849 Sep 01 07:37:56.652302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1394/2773] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:56 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:57.669347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:57.669976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:57.671510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:57.672112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:57.676294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:57.676797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:57.677243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:57.677932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:57.678335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:57.678451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:57.678799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:57.678911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:57.679225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:57.679892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:57.680332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:57.680741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:57.696179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:37:57.869377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:57.873877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:57.880041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-073cb72f-b9f2-49a7-97d4-cbcd5f86bfb4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214499 Sep 01 07:37:57.880627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1380/2774] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:57 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:37:57.882192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-10de6ab5-b0b4-453e-9d9a-4edb3e02c028 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214331 Sep 01 07:37:57.882780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1395/2775] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:57 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:58.900962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:58.901604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:58.902498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:37:58.903107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:37:58.908087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:58.908568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:58.909000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:58.909421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:58.909789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:58.909903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:58.910240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:58.910360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:58.910666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:58.910983 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:37:58.911431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:37:58.911853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:37:59.101280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:59.104337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:37:59.109994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce90025d-41f1-4af9-9187-437b9ae9cb8c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211206 Sep 01 07:37:59.111113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1396/2776] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:58 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:37:59.113971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0acaf764-339f-4fae-b6c1-72770df6497a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216708 Sep 01 07:37:59.114814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1381/2777] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:37:58 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:00.133083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:00.133701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:00.134357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:00.135002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:00.137265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=50 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:00.139937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:00.140411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:00.140839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:00.141813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:00.142251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:00.142534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:00.142692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:00.143014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:00.143444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:00.144125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:00.144573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:00.144997 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:00.331309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:00.338422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:00.339127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-014873be-2689-467b-a412-68f73ad20955 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209805 Sep 01 07:38:00.339702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1397/2778] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:00 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:00.352809 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd978dab-d5cd-4584-97b9-4080e8cca9de tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.222143 Sep 01 07:38:00.353411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1382/2779] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:00 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:01.359874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:01.360519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:01.366818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:01.367237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:01.367691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:01.368380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:01.369049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:01.369327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:01.374551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:01.375169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:01.381509 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:01.381996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:01.382438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:01.383129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:01.383587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:01.384008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:01.567121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:01.570534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:01.575192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0afedf8a-ffeb-4a28-be69-411653569cbb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.219177 Sep 01 07:38:01.575754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1398/2780] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:01 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:01.579504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f71ac4a7-1963-4637-86f7-2c5ce1b6fa7f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209355 Sep 01 07:38:01.580066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1383/2781] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:01 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:02.596362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:02.596963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:02.599479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:02.600100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:02.603324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:02.603799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:02.604229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:02.604900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:02.605369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:02.605782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:02.606507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:02.606995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:02.607438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:02.608130 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:02.608584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:02.609012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:02.795783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:02.798993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:02.804065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5969b3b1-8a7d-43f4-9df9-8982d662326c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.212095 Sep 01 07:38:02.804916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1399/2782] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:02 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:02.807259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-915e291b-e787-406c-901f-7382ee2a2983 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.211570 Sep 01 07:38:02.807939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1384/2783] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:02 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:03.825450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:03.826056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:03.827554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:03.828200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:03.832434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:03.832914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:03.833378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:03.834062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:03.834516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:03.834657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:03.834942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:03.835076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:03.835424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:03.836115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:03.836571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:03.837000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:03.841107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:04.023379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:04.027452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:04.032159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-145adb8d-6ffa-48b6-9bec-b430c468f92a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210518 Sep 01 07:38:04.033098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1400/2784] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:03 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:04.036125 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3581c088-8cc8-4dfd-bede-2e32938a903f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212322 Sep 01 07:38:04.036689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1385/2785] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:03 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:05.053246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:05.053866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:05.055571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:05.056188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:05.056318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=50 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:05.061608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:05.062087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:05.062526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:05.062703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:05.063146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:05.063290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:05.063586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:05.063714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:05.064093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:05.064275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:05.064725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:05.065180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:05.254604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:05.261576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:05.262844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac4829e8-4839-4a87-a4e7-4498890a170e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213631 Sep 01 07:38:05.263607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1401/2786] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:05 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:05.270235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ab42e834-0260-4bfc-9428-93a76b1117fc tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218473 Sep 01 07:38:05.270795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1386/2787] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:05 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:06.284409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:06.285146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:06.292098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:06.292570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:06.292994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:06.293702 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:06.294363 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:06.294845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:06.295739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:06.296386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:06.302961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:06.303455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:06.303886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:06.304582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:06.305030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:06.305483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:06.487223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:06.493590 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:06.495436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f26f370f-f22e-4c24-8147-8290f4376757 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214890 Sep 01 07:38:06.496013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1402/2788] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:06 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:06.502492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e8bab40d-c50f-488e-b321-fcc94d7a019f tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210595 Sep 01 07:38:06.503049 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1387/2789] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:06 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:07.515900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:07.524130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:07.526686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:07.527167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:07.527288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:07.527399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:07.527728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:07.528406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:07.528857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:07.529818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:07.534094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:07.534577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:07.535015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:07.535703 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:07.536154 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:07.536578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:07.723161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:07.726061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:07.731397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-70e460cf-0163-4d07-baff-5ee8772383ad tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.208694 Sep 01 07:38:07.731978 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1388/2790] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:07 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:07.734134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c32d1bf-8926-4aa7-bcf3-49317f3c506b tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.222224 Sep 01 07:38:07.734681 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1403/2791] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:07 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:08.752481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:08.753038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:08.754808 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:08.755418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:08.759585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:08.760076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:08.760529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:08.761278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:08.761706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:08.761847 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:08.762161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:08.762280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:08.762601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:08.763277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:08.763770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:08.764191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:08.950682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:08.954547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:08.958971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-923bdc56-8427-4a52-9a56-209ad0ec3aa2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.210412 Sep 01 07:38:08.959542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1389/2792] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:08 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:08.962786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11556fbd-19d6-4e35-9a62-129f3867dbf6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.211682 Sep 01 07:38:08.963349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1404/2793] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:08 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:09.980111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:09.980723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:09.983985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:09.984587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:09.987761 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:09.988243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:09.988676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:09.989386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:09.989838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:09.990260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:09.991013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:09.991493 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:09.991921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:09.992597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:09.993067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:09.993507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:10.177481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:10.183976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:10.186394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cf3bf9e3-abc0-41a6-bd30-ba909bae3c0d tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209489 Sep 01 07:38:10.186983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1390/2794] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:09 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:10.194950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-100e9d4e-da50-47f4-ad96-78cf54b42ac7 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.214454 Sep 01 07:38:10.195547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1405/2795] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:09 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:11.210923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:11.211526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:11.218073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:11.218557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:11.218988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:11.219675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:11.219800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:11.220234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:11.220352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:11.220540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:11.226546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:11.227017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:11.227440 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:11.228113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:11.228551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:11.228969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:11.654920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:11.663138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e4259d67-512b-49c5-a416-024693eb7ed3 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.455957 Sep 01 07:38:11.663792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1391/2796] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:11 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:11.665371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:11.674037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70c5f1d5-341b-4969-bf53-1d38b08de1c3 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.458472 Sep 01 07:38:11.674571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1406/2797] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:11 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:12.684272 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:12.684878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:12.691803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:12.692288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:12.692726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:12.693440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:12.693900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:12.694323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:12.695068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:12.695673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:12.703168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:12.703637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:12.704065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:12.704765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:12.705232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:12.705647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:12.886844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:12.890591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:12.895615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1655e4f1-cc08-4b18-a3c9-cebbe85a8770 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215184 Sep 01 07:38:12.896193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1392/2798] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:12 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:12.899064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a5b6277-bf62-4743-bc2d-f2c45120c2de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.208148 Sep 01 07:38:12.899617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1407/2799] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:12 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:13.916224 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:13.916905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:13.919286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:13.919891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:13.923580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:13.924064 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:13.924501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:13.925230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:13.925686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:13.926115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:13.926435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:13.926939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:13.927368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:13.928040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:13.928488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:13.928911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:14.113459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:14.116333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:14.121918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b5ec44c1-7a67-4195-bafc-67b0c9498e48 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.209506 Sep 01 07:38:14.122500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1393/2800] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:13 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:14.126063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de163523-6483-4dc9-a5c4-5e5b1cceac60 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210547 Sep 01 07:38:14.126637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1408/2801] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:13 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:15.143548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:15.144165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:15.147460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:15.148055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:15.150589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:15.151080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:15.151517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:15.152210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:15.152666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:15.153088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:15.154986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:15.155454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:15.155883 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:15.156557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:15.156996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:15.157436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:15.344647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:15.347909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:15.352838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e9f52d9-660f-40bc-8078-d72c10172e02 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.209110 Sep 01 07:38:15.353435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1409/2802] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:15 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:15.356088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4d72c3bc-b34d-4aa6-9061-68d5dbf044a2 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216743 Sep 01 07:38:15.356648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1394/2803] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:15 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:16.373683 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:16.374285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:16.375732 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:16.376348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:16.380789 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:16.381305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:16.381733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:16.382415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:16.382752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:16.382890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:16.383240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:16.383364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:16.383681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:16.384372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:16.384825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:16.385287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:16.579030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:16.582170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:16.587300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf8ee6d1-9e7a-444d-82a2-8bb588db5c28 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217532 Sep 01 07:38:16.587957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1410/2804] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:16 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:16.590365 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-db8e01c5-a9e8-47f0-9f18-ae577d10e72a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.218464 Sep 01 07:38:16.590917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1395/2805] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:16 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:17.609851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:17.610589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:17.611578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:17.612194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:17.617065 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:17.617573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:17.618004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:17.618430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:17.618687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:17.618914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:17.619135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:17.619352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:17.619553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:17.620035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:17.620490 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:17.620914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:17.817416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:17.820636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:17.825601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-597bfb57-a2d4-42e1-8448-78741979415f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.220039 Sep 01 07:38:17.826201 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1411/2806] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:17 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:17.828752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3a21c46c-cbd8-4ba3-92c8-cf5765895c15 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.221373 Sep 01 07:38:17.829337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1396/2807] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:17 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:18.847309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:18.847903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:18.849024 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:18.849659 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:18.854438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:18.854911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:18.855337 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:18.856010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:18.856446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:18.856678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:18.856856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:18.857174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:18.857608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:18.858284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:18.858730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:18.859156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:18.859373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:19.045608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:19.049835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:19.054362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19111acf-eaec-49d4-b81d-d145d19aef48 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.210970 Sep 01 07:38:19.054937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1412/2808] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:18 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:19.057947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e623fa7-d4c5-413f-b5be-f4276c731033 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212687 Sep 01 07:38:19.058499 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1397/2809] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:18 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:20.075422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:20.076060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:20.078138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:20.078750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:20.082544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:20.083022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:20.083455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:20.084134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:20.084578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:20.084918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:20.085038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:20.085431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:20.085866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:20.086541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:20.086988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:20.087404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:20.277638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:20.282151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:20.286436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b213e3f-7852-4917-b6cf-8aceccceeab4 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212056 Sep 01 07:38:20.287010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1398/2810] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:20 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:20.290517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b173d5de-3b0e-4492-8395-cb3d5317c33d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.218900 Sep 01 07:38:20.291073 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1413/2811] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:20 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:21.307669 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:21.308274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:21.311799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:21.312399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:21.315390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:21.315878 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:21.316318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:21.317011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:21.317494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:21.317921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:21.318736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:21.319206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:21.319636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:21.320314 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:21.320755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:21.321192 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:21.512161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:21.516692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:21.520653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-035d6fcf-881c-46bb-b840-2d71f601294b tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.216774 Sep 01 07:38:21.521249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1399/2812] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:21 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:21.524915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e659d2da-95e4-4787-91e0-68f243b993eb tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217408 Sep 01 07:38:21.525505 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1414/2813] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:21 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:22.541845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:22.542445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:22.546677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:22.547288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:22.549576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:22.550066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:22.550507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:22.551200 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:22.551651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:22.552159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:22.553834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:22.554315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:22.554754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:22.555432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:22.555884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:22.556302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:22.739754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:22.744106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:22.748938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f99c816-9a38-44b3-a079-f62ea0ac2944 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.206567 Sep 01 07:38:22.749580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1415/2814] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:22 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:22.753355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-46cca9eb-1e61-4965-88bb-8903eec1a4f8 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.215286 Sep 01 07:38:22.754397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1400/2815] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:22 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:22.757291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:22.758010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:22.764182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:22.764662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:22.765259 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:22.765951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:22.766649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:22.767077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:22.792914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:38:22.869554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43d62fea-4f2e-4c85-86d7-23f1f7c5b9ae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "DELETE /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 204 len: 0 microversion: 2.20 time: 0.118726 Sep 01 07:38:22.870151 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1416/2816] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Sep 1 07:38:22 2022] DELETE /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 07:38:22.879218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:22.880248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:22.886055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:22.886551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:22.886979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:22.887668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:22.888145 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:22.888573 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:23.014165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:23.016333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=100 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:23.023781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:23.025252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:23.026405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-15a24f75-1c43-44b0-8490-0604e6d7252a tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1724 microversion: 2.20 time: 0.151350 Sep 01 07:38:23.026965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1401/2817] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:38:22 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:38:23.771563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:23.772263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:23.774150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:23.774757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:23.778726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:23.779204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:23.779642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:23.780327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:23.780805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:23.780941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:23.781254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:23.781453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:23.781886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:23.782567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:23.783008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:23.783426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:23.972372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:23.976952 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:23.980604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75716cab-10b2-4ff1-a484-1afcb243224c tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.213380 Sep 01 07:38:23.981195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1417/2818] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:23 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:23.985385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca98f467-a34b-4889-b3c1-8792efa04e3e tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.214951 Sep 01 07:38:23.985945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1402/2819] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:23 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:24.050328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:24.050932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:24.056786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:24.057365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:24.057797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:24.058470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:24.058910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:24.059326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:24.187179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:24.195246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:24.196686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:24.197859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31bade66-8783-4ceb-8946-5ec2ca1a0b87 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1724 microversion: 2.20 time: 0.151459 Sep 01 07:38:24.198414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1418/2820] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:38:24 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:38:25.000968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:25.002343 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:25.006467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:25.007737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:25.008776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:25.009581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:25.009959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:25.010624 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:25.011077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:25.011770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:25.015441 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:25.015928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:25.016813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:25.017765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:25.018214 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:25.018720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:25.276922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:25.284888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:25.285150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2ec504dc-c346-429a-9784-0b1885c01f4e tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.288043 Sep 01 07:38:25.285937 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1403/2821] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:24 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:25.290635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:25.291243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:25.294160 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3f535c9-e664-4789-96f2-c52d1d692502 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.291492 Sep 01 07:38:25.294971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1419/2822] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:25 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:25.297494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:25.297987 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:25.298426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:25.299124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:25.299577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:25.300000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:25.392621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:25.399437 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:25.400888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:25.402078 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-10347713-4b07-4ce3-a23d-05b244e0b8f8 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1656 microversion: 2.20 time: 0.115015 Sep 01 07:38:25.402634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1404/2823] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:38:25 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1656 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:38:25.655854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-9acf758d-615f-4236-a20f-53581b2012bc req-4d72dce0-d8bd-409c-bd5c-5624b98aa612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d2af7b-7f82-4fa4-8615-4ac5606b7c29", "name": "network-vif-deleted", "tag": "5ef78fde-5aa9-4ebd-a8dc-9ea291c3c6b3"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:38:25.666275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9acf758d-615f-4236-a20f-53581b2012bc req-4d72dce0-d8bd-409c-bd5c-5624b98aa612 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:25.666829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9acf758d-615f-4236-a20f-53581b2012bc req-4d72dce0-d8bd-409c-bd5c-5624b98aa612 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:25.667360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9acf758d-615f-4236-a20f-53581b2012bc req-4d72dce0-d8bd-409c-bd5c-5624b98aa612 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:25.682929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-9acf758d-615f-4236-a20f-53581b2012bc req-4d72dce0-d8bd-409c-bd5c-5624b98aa612 service nova] Creating event network-vif-deleted:5ef78fde-5aa9-4ebd-a8dc-9ea291c3c6b3 for instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 on hv-cinder-73306 Sep 01 07:38:25.689573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-9acf758d-615f-4236-a20f-53581b2012bc req-4d72dce0-d8bd-409c-bd5c-5624b98aa612 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037829 Sep 01 07:38:25.690778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1420/2824] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:38:26.308488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:26.309104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:26.316484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:26.317224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:26.317634 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:26.318221 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:26.318559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:26.319266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:26.319889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:26.320315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:26.324252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:26.326729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:26.326729 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:26.326989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:26.327237 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:26.327659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:26.525795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:26.530979 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:26.540249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f832dc3-034a-444b-baac-6fe86d7ceba5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.228310 Sep 01 07:38:26.541244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1421/2825] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:26 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:26.543521 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-557cc6ca-f88d-427a-8bb9-c1c8a5304606 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.238822 Sep 01 07:38:26.544458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1405/2826] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:26 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:26.547319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:26.548130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:26.564043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:26.564527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:26.564958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:26.565689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:26.566137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:26.566776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:26.600864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:26.601379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:26.602017 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:26.603119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lazy-loading 'fault' on Instance uuid 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:38:26.653945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:26.663209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:26.666032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2096dd4d4b6f49fc8572a4bcd9689248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2774daeaf2945eea5b6f33ad4ea2bdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:26.667213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3a8c270d-5c22-4e0c-a488-7393e5139496 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 200 len: 1372 microversion: 2.20 time: 0.124722 Sep 01 07:38:26.667767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1422/2827] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:38:26 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 07:38:27.562917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:27.563530 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:27.564863 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:27.565491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:27.570483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:27.570964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:27.571399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:27.571960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:27.572087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:27.572430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:27.572567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:27.572857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:27.572984 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:27.573554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:27.574000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:27.574413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:27.761907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:27.770154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:27.771321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bfffb705-4f44-4a2c-bfa3-cfe32bbbca31 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212120 Sep 01 07:38:27.771910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1406/2828] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:27 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:27.779528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37c15907-8861-42ef-b169-e8dea032d6de tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.217881 Sep 01 07:38:27.780317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1423/2829] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:27 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:27.781888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:27.782501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:27.788386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:27.788870 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:27.789388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:27.790074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:27.790528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:27.790954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:27.804460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] HTTP exception thrown: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Request method failure captured: Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 HTTP/1.1 Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFvFNA3S83IXUPmcRwfpDuOdVGd4jq_D0mXyc4FBEzlHGbyT_Rzj9gAgMs8kdVzSjgnq2tyWMLlp1K1-tzMfDjogKHNOt_0gX8z5g1ISPlxwgzqEFsOvwVOyxKvhgcLT_rmYPaV9y9kVDtDD3A6m6iUpZWU8h4az15IIAZOP1-2L5Rs Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:38:27.806150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e2774daeaf2945eea5b6f33ad4ea2bdf", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 2096dd4d4b6f49fc8572a4bcd9689248 Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:27.808160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '38d2af7b-7f82-4fa4-8615-4ac5606b7c29'} Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:38:27.809481 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:27.811385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:27.813090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Returning 404 to user: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:38:27.813090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f4287b53-d309-49a3-84b7-445fbbb3b3d3 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 404 len: 111 microversion: 2.20 time: 0.030070 Sep 01 07:38:27.813090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1407/2830] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:38:27 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:38:27.816595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a670bb35-3d2a-4145-be9c-0c617210d6da tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '.version_select at 0x7f78cf3a2e50>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:27.834685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a670bb35-3d2a-4145-be9c-0c617210d6da tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391427530" status: 204 len: 0 microversion: 2.20 time: 0.021817 Sep 01 07:38:27.835213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1424/2831] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Sep 1 07:38:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391427530 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 07:38:28.444727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:28.445241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:28.451902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:28.452689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:28.453144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:28.453869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:28.454318 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:28.454739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:28.469391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] HTTP exception thrown: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Request method failure captured: Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 HTTP/1.1 Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFvFNA3S83IXUPmcRwfpDuOdVGd4jq_D0mXyc4FBEzlHGbyT_Rzj9gAgMs8kdVzSjgnq2tyWMLlp1K1-tzMfDjogKHNOt_0gX8z5g1ISPlxwgzqEFsOvwVOyxKvhgcLT_rmYPaV9y9kVDtDD3A6m6iUpZWU8h4az15IIAZOP1-2L5Rs Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:38:28.470935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e2774daeaf2945eea5b6f33ad4ea2bdf", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 2096dd4d4b6f49fc8572a4bcd9689248 Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.472784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '38d2af7b-7f82-4fa4-8615-4ac5606b7c29'} Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:38:28.473832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.475483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.477458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Returning 404 to user: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:38:28.477458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-30d2b0d8-80b5-460a-9d79-160598b40c6b tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "DELETE /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 404 len: 111 microversion: 2.20 time: 0.031851 Sep 01 07:38:28.477458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1408/2832] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Sep 1 07:38:28 2022] DELETE /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 07:38:28.481878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:28.482655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 38d2af7b-7f82-4fa4-8615-4ac5606b7c29] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:28.488664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:28.489247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:28.489866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:28.490606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:28.491119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:28.491606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:28.506127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] HTTP exception thrown: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Request method failure captured: Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 HTTP/1.1 Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFvFNA3S83IXUPmcRwfpDuOdVGd4jq_D0mXyc4FBEzlHGbyT_Rzj9gAgMs8kdVzSjgnq2tyWMLlp1K1-tzMfDjogKHNOt_0gX8z5g1ISPlxwgzqEFsOvwVOyxKvhgcLT_rmYPaV9y9kVDtDD3A6m6iUpZWU8h4az15IIAZOP1-2L5Rs Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:38:28.507799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e2774daeaf2945eea5b6f33ad4ea2bdf", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 2096dd4d4b6f49fc8572a4bcd9689248 Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.510172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '38d2af7b-7f82-4fa4-8615-4ac5606b7c29'} Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:38:28.511733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. Sep 01 07:38:28.514209 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:38:28.515890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Returning 404 to user: Instance 38d2af7b-7f82-4fa4-8615-4ac5606b7c29 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:38:28.515890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0464787c-4ba8-4546-8e29-1806da69ac51 tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29" status: 404 len: 111 microversion: 2.20 time: 0.031426 Sep 01 07:38:28.515890 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1425/2833] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:38:28 2022] GET /compute/v2.1/servers/38d2af7b-7f82-4fa4-8615-4ac5606b7c29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:38:28.799705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:28.800244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:28.800666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:28.800780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:28.806189 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:28.806661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:28.806807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:28.807092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:28.807203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:28.807540 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:28.807803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:28.808240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:28.808358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:28.808660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:28.808770 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:28.809085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:29.000249 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:29.003923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:29.008557 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a107eda9-45c4-4c7a-bf65-7eaa24f0b5c6 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.212656 Sep 01 07:38:29.009144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1409/2834] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:28 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:29.011859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd811c8c-a458-40b8-a4ec-f0ff7d5fb81f tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.215716 Sep 01 07:38:29.012406 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1426/2835] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:28 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:30.029651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:30.030269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] [instance: e1ac467b-0a5f-4e70-952c-3bead582e098] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:30.036416 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:30.036956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:30.037240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 56872759-8d04-492f-8020-a8143079785a] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:38:30.037697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:30.038274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:30.038784 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:30.039321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:30.039803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:30.043991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:30.045272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:30.045560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:30.046239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:30.046733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:30.047161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:30.235779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a537ff040dc4559b103696638cdd9d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670ca9b5239a4c5f9aa30faca7a4e519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:30.243586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:38:30.246071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a7abe173-4023-4ca8-b8cc-e1fafa32f8f5 tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098" status: 200 len: 1599 microversion: 2.1 time: 0.220636 Sep 01 07:38:30.252876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2bc842b6-2595-479c-ba57-d33e17a37679 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a" status: 200 len: 1737 microversion: 2.1 time: 0.224451 Sep 01 07:38:30.253466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1427/2836] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:30 2022] GET /compute/v2.1/servers/56872759-8d04-492f-8020-a8143079785a => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:38:30.261458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1410/2837] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:38:30 2022] GET /compute/v2.1/servers/e1ac467b-0a5f-4e70-952c-3bead582e098 => generated 1599 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:38:30.268930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-949429d3-fd8c-450e-87a0-1eddb2551e9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] Calling method '.version_select at 0x7f78d2acb9d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:30.277225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ee7b1c32-0f17-456e-9aa4-53e73d2d64b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '.version_select at 0x7f78d2b64ee0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:38:30.291411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-949429d3-fd8c-450e-87a0-1eddb2551e9a tempest-TestMinimumBasicScenario-706400232 tempest-TestMinimumBasicScenario-706400232-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-728893866" status: 202 len: 0 microversion: 2.1 time: 0.028222 Sep 01 07:38:30.291660 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=58 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:30.295321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1428/2838] 10.222.0.46 () {58 vars in 1269 bytes} [Thu Sep 1 07:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-728893866 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 07:38:30.305515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ee7b1c32-0f17-456e-9aa4-53e73d2d64b6 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601860216" status: 202 len: 0 microversion: 2.1 time: 0.034469 Sep 01 07:38:30.306396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1411/2839] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Sep 1 07:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601860216 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 07:38:31.365037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-36cab98a-65f0-4a9c-8d3a-483648d45ee8 req-85468ae2-7eec-476b-b3d2-f1620950ed3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56872759-8d04-492f-8020-a8143079785a", "tag": "4a7088df-c8f1-43bf-9d2a-48042b8faf52"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:38:31.376095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-36cab98a-65f0-4a9c-8d3a-483648d45ee8 req-85468ae2-7eec-476b-b3d2-f1620950ed3d service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:31.376574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-36cab98a-65f0-4a9c-8d3a-483648d45ee8 req-85468ae2-7eec-476b-b3d2-f1620950ed3d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:31.377091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-36cab98a-65f0-4a9c-8d3a-483648d45ee8 req-85468ae2-7eec-476b-b3d2-f1620950ed3d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:31.387677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-36cab98a-65f0-4a9c-8d3a-483648d45ee8 req-85468ae2-7eec-476b-b3d2-f1620950ed3d service nova] Creating event network-changed:4a7088df-c8f1-43bf-9d2a-48042b8faf52 for instance 56872759-8d04-492f-8020-a8143079785a on hv-cinder-73306 Sep 01 07:38:31.393899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-36cab98a-65f0-4a9c-8d3a-483648d45ee8 req-85468ae2-7eec-476b-b3d2-f1620950ed3d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092507 Sep 01 07:38:31.394903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1429/2840] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:38:43.989269 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=47 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:43.991258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:44.171588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8ebec279-7780-4d53-8283-e69cb70fca9b tempest-TestShelveInstance-1318093024 tempest-TestShelveInstance-1318093024-project] Action: 'create', calling method: .version_select at 0x7f78cf2fef70>, body: {"keypair": {"name": "tempest-TestShelveInstance-74448833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1xLg3AcULR0yUVCZqxDWlgkj+2zm+WsML1E5OCeSB3ESNPe8SiU6X2OYBel8fS4pMTO7OohpD9H/hlDbzzoo6lfOtMw2WrPXjIxxDWB8O2OrE3Xm6roT9vkUc8dx3CUw=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:38:44.187773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-8ebec279-7780-4d53-8283-e69cb70fca9b tempest-TestShelveInstance-1318093024 tempest-TestShelveInstance-1318093024-project] Getting quotas for project bbc5effaf211410eb0b8872c2be553da. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:38:44.191919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-8ebec279-7780-4d53-8283-e69cb70fca9b tempest-TestShelveInstance-1318093024 tempest-TestShelveInstance-1318093024-project] Getting quotas for user d3a4f1b15f0442578e65b810edfb4923 and project bbc5effaf211410eb0b8872c2be553da. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:38:44.217370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8ebec279-7780-4d53-8283-e69cb70fca9b tempest-TestShelveInstance-1318093024 tempest-TestShelveInstance-1318093024-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.233280 Sep 01 07:38:44.217986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1412/2841] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:38:43 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:38:59.142138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:59.143332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:38:59.149296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b6036c22-7f6c-4f49-bd7e-ebd179382598 req-43cd13ab-d16c-4426-9213-fc08a7afa6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ac467b-0a5f-4e70-952c-3bead582e098", "name": "network-vif-deleted", "tag": "af5f2bad-da1c-41a1-9b9f-c7eac9bc052a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:38:59.167601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b6036c22-7f6c-4f49-bd7e-ebd179382598 req-43cd13ab-d16c-4426-9213-fc08a7afa6e0 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:38:59.168122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b6036c22-7f6c-4f49-bd7e-ebd179382598 req-43cd13ab-d16c-4426-9213-fc08a7afa6e0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:38:59.168557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b6036c22-7f6c-4f49-bd7e-ebd179382598 req-43cd13ab-d16c-4426-9213-fc08a7afa6e0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:38:59.182793 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b6036c22-7f6c-4f49-bd7e-ebd179382598 req-43cd13ab-d16c-4426-9213-fc08a7afa6e0 service nova] Creating event network-vif-deleted:af5f2bad-da1c-41a1-9b9f-c7eac9bc052a for instance e1ac467b-0a5f-4e70-952c-3bead582e098 on hv-cinder-73306 Sep 01 07:38:59.187613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b6036c22-7f6c-4f49-bd7e-ebd179382598 req-43cd13ab-d16c-4426-9213-fc08a7afa6e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047401 Sep 01 07:38:59.188210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1430/2842] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:44:31.994676 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc108816-5355-489c-b59a-639bb8bc4023] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 07:44:31.995240 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:44:31.996014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:44:31.997163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 07:44:31.997313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:44:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 (ip 10.222.0.46) !!! Sep 01 07:44:31.998251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:44:31.998395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:44:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 (ip 10.222.0.46) !!! Sep 01 07:44:32.000099 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:44:32.000230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 (ip 10.222.0.46) !!! Sep 01 07:44:32.006127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:44:32.006621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:44:32.017491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:44:32.017955 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:44:32.018395 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:44:32.019092 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:44:32.019547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:44:32.020245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:44:32.033872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] HTTP exception thrown: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Request method failure captured: Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: DELETE /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 HTTP/1.1 Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFvFNA3S83IXUPmcRwfpDuOdVGd4jq_D0mXyc4FBEzlHGbyT_Rzj9gAgMs8kdVzSjgnq2tyWMLlp1K1-tzMfDjogKHNOt_0gX8z5g1ISPlxwgzqEFsOvwVOyxKvhgcLT_rmYPaV9y9kVDtDD3A6m6iUpZWU8h4az15IIAZOP1-2L5Rs Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:44:32.035944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e2774daeaf2945eea5b6f33ad4ea2bdf", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 2096dd4d4b6f49fc8572a4bcd9689248 Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.037975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '179bc01d-7bec-423c-8b0f-170bfa0d6ab0'} Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:44:32.039111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.040852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.042550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Returning 404 to user: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:44:32.042550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e9675cdf-5428-48e7-9fea-b0b0930c8bae tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "DELETE /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 404 len: 111 microversion: 2.20 time: 0.044827 Sep 01 07:44:32.042550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1413/2843] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Sep 1 07:44:31 2022] DELETE /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:44:32.044119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11375ac0-d7e8-4c00-a589-a2d2741b56e8] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 07:44:32.044692 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:44:32.045436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:44:32.046435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 07:44:32.046568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 (ip 10.222.0.46) !!! Sep 01 07:44:32.048503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 07:44:32.048635 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 (ip 10.222.0.46) !!! Sep 01 07:44:32.050339 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 07:44:32.050589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 (ip 10.222.0.46) !!! Sep 01 07:44:32.059565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:44:32.060258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] [instance: 179bc01d-7bec-423c-8b0f-170bfa0d6ab0] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:44:32.076666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:44:32.077083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:44:32.077541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:44:32.078227 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:44:32.078673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:44:32.079096 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:44:32.092041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] HTTP exception thrown: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Request method failure captured: Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 HTTP/1.1 Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFvFNA3S83IXUPmcRwfpDuOdVGd4jq_D0mXyc4FBEzlHGbyT_Rzj9gAgMs8kdVzSjgnq2tyWMLlp1K1-tzMfDjogKHNOt_0gX8z5g1ISPlxwgzqEFsOvwVOyxKvhgcLT_rmYPaV9y9kVDtDD3A6m6iUpZWU8h4az15IIAZOP1-2L5Rs Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:44:32.093710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e2774daeaf2945eea5b6f33ad4ea2bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e2774daeaf2945eea5b6f33ad4ea2bdf", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: e2774daeaf2945eea5b6f33ad4ea2bdf Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106939934 Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 2096dd4d4b6f49fc8572a4bcd9689248 Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106939934-project Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.095607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '179bc01d-7bec-423c-8b0f-170bfa0d6ab0'} Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:44:32.096676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. Sep 01 07:44:32.098376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:44:32.099904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] Returning 404 to user: Instance 179bc01d-7bec-423c-8b0f-170bfa0d6ab0 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:44:32.099904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-702ba459-b246-4f54-89ea-5eecf4eefe4c tempest-AttachVolumeShelveTestJSON-106939934 tempest-AttachVolumeShelveTestJSON-106939934-project] 10.222.0.46 "GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0" status: 404 len: 111 microversion: 2.20 time: 0.052882 Sep 01 07:44:32.099904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1431/2844] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 07:44:32 2022] GET /compute/v2.1/servers/179bc01d-7bec-423c-8b0f-170bfa0d6ab0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:44:36.241160 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc108816-5355-489c-b59a-639bb8bc4023] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 32794. Sep 01 07:44:36.367359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c764fb83-e47c-43bc-a9e7-f66c4b3a71a3 tempest-VolumesSnapshotsTestJSON-2100815425 tempest-VolumesSnapshotsTestJSON-2100815425-project] Action: 'create', calling method: .version_select at 0x7f78cf2fe9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-182515537"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:44:42.022357 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:44:42.025080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:46:32.288212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c764fb83-e47c-43bc-a9e7-f66c4b3a71a3 tempest-VolumesSnapshotsTestJSON-2100815425 tempest-VolumesSnapshotsTestJSON-2100815425-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 116.058702 Sep 01 07:46:32.289028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1414/2845] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Sep 1 07:44:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 116060 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 07:46:32.613484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:46:32.614355 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:46:32.620494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-329aa4c2-0acb-430d-87da-0bc8494e218f tempest-TestShelveInstance-1318093024 tempest-TestShelveInstance-1318093024-project] Calling method '.version_select at 0x7f78d2b951f0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:46:32.631666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] [11375ac0-d7e8-4c00-a589-a2d2741b56e8] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 32900. Sep 01 07:46:32.647950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-329aa4c2-0acb-430d-87da-0bc8494e218f tempest-TestShelveInstance-1318093024 tempest-TestShelveInstance-1318093024-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-74448833" status: 202 len: 0 microversion: 2.1 time: 0.036625 Sep 01 07:46:32.648515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1432/2846] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:46:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-74448833 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:46:49.576312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-745694fa-2a65-44bb-8bea-e4d474dde64c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Action: 'create', calling method: .version_select at 0x7f78cf1f4670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-159046410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKEEWCSPMMdeYb0xz/maibx+N8QkmvdjnevCGMALgsfGtcCu4zXyJbSgibC41O3xDJI/QYFFDIvu5LzcVGxioOvDqXPbuwb+QajY2BcOHdXpbX+iC2H1UsoJ9cCMfwLpQ=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:46:49.592704 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-745694fa-2a65-44bb-8bea-e4d474dde64c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Getting quotas for project df5069d6a3a34a08bb00105a91251cf2. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:46:49.596769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-745694fa-2a65-44bb-8bea-e4d474dde64c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Getting quotas for user 93b2cf587dc44209a186fc453ac5bdfc and project df5069d6a3a34a08bb00105a91251cf2. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:46:49.623735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-745694fa-2a65-44bb-8bea-e4d474dde64c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.247663 Sep 01 07:46:49.624694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1415/2847] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:46:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:02.710611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11375ac0-d7e8-4c00-a589-a2d2741b56e8] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 07:49:02.711168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:02.712270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:49:02.712423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 01 07:49:02.713470 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:49:02.713601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 01 07:49:02.911919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-d736e258-36af-4b6a-9c45-00a704d2e87c req-c33b48c5-9b0d-4722-b4b8-a7989d73ff5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56872759-8d04-492f-8020-a8143079785a", "name": "network-vif-deleted", "tag": "4a7088df-c8f1-43bf-9d2a-48042b8faf52"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:02.922316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d736e258-36af-4b6a-9c45-00a704d2e87c req-c33b48c5-9b0d-4722-b4b8-a7989d73ff5c service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:02.922898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d736e258-36af-4b6a-9c45-00a704d2e87c req-c33b48c5-9b0d-4722-b4b8-a7989d73ff5c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:02.923329 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d736e258-36af-4b6a-9c45-00a704d2e87c req-c33b48c5-9b0d-4722-b4b8-a7989d73ff5c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:02.934162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-d736e258-36af-4b6a-9c45-00a704d2e87c req-c33b48c5-9b0d-4722-b4b8-a7989d73ff5c service nova] Creating event network-vif-deleted:4a7088df-c8f1-43bf-9d2a-48042b8faf52 for instance 56872759-8d04-492f-8020-a8143079785a on hv-cinder-73306 Sep 01 07:49:02.940557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-d736e258-36af-4b6a-9c45-00a704d2e87c req-c33b48c5-9b0d-4722-b4b8-a7989d73ff5c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232298 Sep 01 07:49:02.941252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1433/2848] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:03.765779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:03.766599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:03.767627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:49:03.767837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Sep 01 07:49:03.769264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:49:03.769527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Sep 01 07:49:03.777501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1557434232", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "networks": [{"uuid": "3ff513bc-8cfa-41bb-9f08-487806c0a2e2"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:03.858106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] validate_networks() for [('3ff513bc-8cfa-41bb-9f08-487806c0a2e2', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:49:04.364512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:49:04.364938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:49:04.365443 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:49:04.365850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:49:04.366353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:49:04.375055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:04.375534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:04.375969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:04.376693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:04.377168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:04.377599 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:04.394345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Getting quotas for project 7170a1232ab14cd4aff705e91364d5c1. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:49:04.399055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Getting quotas for user c6a74f33e6e941ed8c3f7850bdf29bb0 and project 7170a1232ab14cd4aff705e91364d5c1. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:49:04.410171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:49:04.412439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:49:04.461110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fee85b45-47ed-4202-9de8-3bf511bc26b1 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696428 Sep 01 07:49:04.461685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1416/2849] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:49:04.473768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b01e7b41-9c26-4c3c-9a7b-b5bca205c218 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:04.475596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b01e7b41-9c26-4c3c-9a7b-b5bca205c218 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:04.490872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] [11375ac0-d7e8-4c00-a589-a2d2741b56e8] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 33244. Sep 01 07:49:04.662454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:04.662972 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:04.670006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:04.670501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:04.670947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:04.671648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:04.672108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:04.672537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:04.692064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b01e7b41-9c26-4c3c-9a7b-b5bca205c218 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:04.699672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:49:04.700110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b01e7b41-9c26-4c3c-9a7b-b5bca205c218 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1219 microversion: 2.1 time: 0.231072 Sep 01 07:49:04.700788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1434/2850] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:04 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1219 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:04.776709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9fabf848-6ec6-4e71-8ce5-161e6c1feb27 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 204 len: 0 microversion: 2.1 time: 0.119089 Sep 01 07:49:04.777310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1417/2851] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:49:04 2022] DELETE /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 07:49:04.784996 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:04.785614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:04.792444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:04.792918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:04.793375 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:04.794089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:04.794526 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:04.794941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:04.930841 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:04.938446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1e51ec9a-e630-42aa-ae7b-8ffd00035368 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1506 microversion: 2.1 time: 0.157178 Sep 01 07:49:04.939001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1435/2852] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:04 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:05.720210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bc2c46f9-00f9-45c3-a538-d5dce577961c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:05.720913 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bc2c46f9-00f9-45c3-a538-d5dce577961c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:05.776476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bc2c46f9-00f9-45c3-a538-d5dce577961c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:05.785793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bc2c46f9-00f9-45c3-a538-d5dce577961c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1219 microversion: 2.1 time: 0.069806 Sep 01 07:49:05.786408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1418/2853] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:05 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:05.958778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:05.959399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:05.966833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:05.967356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:05.967723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:05.968403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:05.968846 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:05.969294 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:06.100310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:06.110809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e5bdf49-6292-48b2-a216-eace24128834 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1506 microversion: 2.1 time: 0.155650 Sep 01 07:49:06.112138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1436/2854] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:05 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:06.396384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-6c1ff2cc-6341-4521-8dc7-aa204a02e020 req-995119e7-e1ce-4755-ae93-c373a8eecfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1d3249-4d55-40bc-a993-ff010dccc5d5", "name": "network-vif-deleted", "tag": "d6a13cfc-bdaf-444d-9009-5a670ed0abf6"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:06.407287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6c1ff2cc-6341-4521-8dc7-aa204a02e020 req-995119e7-e1ce-4755-ae93-c373a8eecfb9 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:06.407808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6c1ff2cc-6341-4521-8dc7-aa204a02e020 req-995119e7-e1ce-4755-ae93-c373a8eecfb9 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:06.408250 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-6c1ff2cc-6341-4521-8dc7-aa204a02e020 req-995119e7-e1ce-4755-ae93-c373a8eecfb9 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:06.420001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-6c1ff2cc-6341-4521-8dc7-aa204a02e020 req-995119e7-e1ce-4755-ae93-c373a8eecfb9 service nova] Creating event network-vif-deleted:d6a13cfc-bdaf-444d-9009-5a670ed0abf6 for instance 9e1d3249-4d55-40bc-a993-ff010dccc5d5 on hv-cinder-73306 Sep 01 07:49:06.425279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-6c1ff2cc-6341-4521-8dc7-aa204a02e020 req-995119e7-e1ce-4755-ae93-c373a8eecfb9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032583 Sep 01 07:49:06.426211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1419/2855] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:06.690275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-3923b540-5bf7-4476-85af-2a786fe0e8cf req-c01e0971-5df9-4249-9d7c-7847118bb8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7a26b0-4589-467a-96a8-d9caeb697915", "name": "network-vif-deleted", "tag": "214057a5-5b50-419f-915c-819a8579477e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:06.704801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3923b540-5bf7-4476-85af-2a786fe0e8cf req-c01e0971-5df9-4249-9d7c-7847118bb8ed service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:06.706510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3923b540-5bf7-4476-85af-2a786fe0e8cf req-c01e0971-5df9-4249-9d7c-7847118bb8ed service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:06.707408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-3923b540-5bf7-4476-85af-2a786fe0e8cf req-c01e0971-5df9-4249-9d7c-7847118bb8ed service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:06.737773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-3923b540-5bf7-4476-85af-2a786fe0e8cf req-c01e0971-5df9-4249-9d7c-7847118bb8ed service nova] Creating event network-vif-deleted:214057a5-5b50-419f-915c-819a8579477e for instance aa7a26b0-4589-467a-96a8-d9caeb697915 on hv-cinder-73306 Sep 01 07:49:06.753077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-3923b540-5bf7-4476-85af-2a786fe0e8cf req-c01e0971-5df9-4249-9d7c-7847118bb8ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141344 Sep 01 07:49:06.756126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1437/2856] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:06.806854 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6b3f7394-eae7-44c1-bfef-5df9907b7f12 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:06.808234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6b3f7394-eae7-44c1-bfef-5df9907b7f12 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:06.904907 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6b3f7394-eae7-44c1-bfef-5df9907b7f12 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:06.912330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6b3f7394-eae7-44c1-bfef-5df9907b7f12 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1219 microversion: 2.1 time: 0.110070 Sep 01 07:49:06.912904 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1420/2857] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:06 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:07.133105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:07.133823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:07.140397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:07.140875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:07.141344 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:07.142031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:07.142478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:07.142904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:07.174125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:07.174535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:07.174964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:07.175399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lazy-loading 'fault' on Instance uuid aa7a26b0-4589-467a-96a8-d9caeb697915 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:49:07.215736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:07.223234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b83d81c-8f7b-4d2e-95b4-d06e05974476 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 200 len: 1310 microversion: 2.1 time: 0.094901 Sep 01 07:49:07.223796 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1438/2858] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:07 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:07.934506 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9807c822-4cf2-481d-a203-e3fef4216b71 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:07.935178 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9807c822-4cf2-481d-a203-e3fef4216b71 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:07.993817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9807c822-4cf2-481d-a203-e3fef4216b71 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:08.000956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9807c822-4cf2-481d-a203-e3fef4216b71 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1219 microversion: 2.1 time: 0.070365 Sep 01 07:49:08.001652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1421/2859] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:07 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:08.243604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:08.244330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: aa7a26b0-4589-467a-96a8-d9caeb697915] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:08.250673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:08.251142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:08.251578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:08.252249 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:08.258844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:08.258844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:08.266397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] HTTP exception thrown: Instance aa7a26b0-4589-467a-96a8-d9caeb697915 could not be found. Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Request method failure captured: Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 HTTP/1.1 Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFvBFFWc6puLNPHy3F-IcgMhvUjqlMzltcrwUBajcvx1etWIhC2rrASYnuJiwBRHYoyD8sjqxApn2ay4Bz_snjhqHekqKNrQ35gssMqLakA1LiYaJ3o8-OnTjJW691ti3PrLANcHhrdA-DRzucAEK5xlDZeeZg7KGvIYpVA9rhtoR5Q Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: c1705474b7954cf1926e9beb2d548587 Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:49:08.268074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1705474b7954cf1926e9beb2d548587", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: c1705474b7954cf1926e9beb2d548587 Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-ServerRescueNegativeTestJSON-547052379-project Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: db4f0928502a43b490de01afc587a846 Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547052379-project Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance aa7a26b0-4589-467a-96a8-d9caeb697915 could not be found. Sep 01 07:49:08.269995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'aa7a26b0-4589-467a-96a8-d9caeb697915'} Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7a26b0-4589-467a-96a8-d9caeb697915 could not be found. Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:49:08.271332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7a26b0-4589-467a-96a8-d9caeb697915 could not be found. Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7a26b0-4589-467a-96a8-d9caeb697915 could not be found. Sep 01 07:49:08.273845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:08.275450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Returning 404 to user: Instance aa7a26b0-4589-467a-96a8-d9caeb697915 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:49:08.275450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2245a74-4ccc-40eb-8bca-bd9a4de2319d tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915" status: 404 len: 111 microversion: 2.1 time: 0.029714 Sep 01 07:49:08.275450 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1439/2860] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:08 2022] GET /compute/v2.1/servers/aa7a26b0-4589-467a-96a8-d9caeb697915 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:49:08.278369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:08.278895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:08.285147 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:08.285824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:08.286267 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:08.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:08.287412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:08.287842 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:08.312665 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:49:08.388436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4878ef36-9e23-4a8b-9fd0-50a0c3d84d8a tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 204 len: 0 microversion: 2.1 time: 0.113248 Sep 01 07:49:08.391679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1422/2861] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:49:08 2022] DELETE /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:49:08.397056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:08.397693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:08.404204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:08.404713 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:08.405159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:08.405840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:08.406283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:08.406693 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:08.537063 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:08.546568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d655048-8a12-46d6-aae6-0bbbfd4d30d2 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1522 microversion: 2.1 time: 0.153555 Sep 01 07:49:08.547193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1440/2862] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:08 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:09.022171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:09.023213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:09.029477 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:09.029956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:09.030389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:09.031069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:09.031512 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:09.031928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:09.093302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:09.100947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d16c4488-9357-4ab2-9a4f-22e9506966f5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1223 microversion: 2.1 time: 0.083020 Sep 01 07:49:09.101545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1423/2863] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:09 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:09.568105 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:09.568754 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:09.589070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:09.593724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:09.594415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:09.595251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:09.595872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:09.596503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:09.978857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:09.986778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f73f7400-8896-44be-b147-c4c964b88108 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1480 microversion: 2.1 time: 0.422816 Sep 01 07:49:09.987425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1441/2864] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:09 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1480 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:10.021106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-9b70bdbc-b7fa-4dc1-9732-7147091a4663 req-81124fd7-ba82-4d0c-8e72-9e9a7e6ea0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e6a8a-bf4f-4892-b8e8-4039c7e96411", "name": "network-vif-deleted", "tag": "f1cd3379-d126-426f-a22a-2cd95d74fd87"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:10.031193 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-9b70bdbc-b7fa-4dc1-9732-7147091a4663 req-81124fd7-ba82-4d0c-8e72-9e9a7e6ea0be service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:10.031752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-9b70bdbc-b7fa-4dc1-9732-7147091a4663 req-81124fd7-ba82-4d0c-8e72-9e9a7e6ea0be service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:10.032081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-9b70bdbc-b7fa-4dc1-9732-7147091a4663 req-81124fd7-ba82-4d0c-8e72-9e9a7e6ea0be service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:10.043424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-9b70bdbc-b7fa-4dc1-9732-7147091a4663 req-81124fd7-ba82-4d0c-8e72-9e9a7e6ea0be service nova] Creating event network-vif-deleted:f1cd3379-d126-426f-a22a-2cd95d74fd87 for instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 on hv-cinder-73306 Sep 01 07:49:10.048322 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-9b70bdbc-b7fa-4dc1-9732-7147091a4663 req-81124fd7-ba82-4d0c-8e72-9e9a7e6ea0be service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030800 Sep 01 07:49:10.048936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1424/2865] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:10.121925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:10.122628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:10.128777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:10.129370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:10.129869 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:10.130638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:10.131245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:10.131662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:10.200200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:10.207781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-601fa125-288b-4769-9f5d-69b71f278d35 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1271 microversion: 2.1 time: 0.089840 Sep 01 07:49:10.208338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1442/2866] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:10 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:11.010566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:11.011686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:11.025438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:11.027640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:11.028278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:11.029814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:11.030734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:11.032329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:11.108366 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:11.109428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:11.110008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:11.111023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lazy-loading 'fault' on Instance uuid 807e6a8a-bf4f-4892-b8e8-4039c7e96411 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:49:11.179454 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4f0928502a43b490de01afc587a846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1705474b7954cf1926e9beb2d548587', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:11.187117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-053be21f-98ac-48f1-8796-a8fe58788ffa tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 200 len: 1311 microversion: 2.1 time: 0.182501 Sep 01 07:49:11.187859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1425/2867] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:11 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 1311 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:11.231587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:11.232186 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:11.239926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:11.240401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:11.241092 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:11.242826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:11.243278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:11.243694 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:11.452284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:11.460276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea63c28f-1f35-42fe-9ea8-1725015f2715 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1319 microversion: 2.1 time: 0.233594 Sep 01 07:49:11.460837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1443/2868] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:11 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:12.070805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-0c0f9e79-ffaf-41a8-ae4d-7a4b8eb207f9 req-096c557b-a297-4cb3-8273-2670926d142e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad62cc52-a7e1-4741-b34d-834be8297826", "tag": "667ef210-a872-48d3-9f05-d3c51aa59ec8"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:12.081498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0c0f9e79-ffaf-41a8-ae4d-7a4b8eb207f9 req-096c557b-a297-4cb3-8273-2670926d142e service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:12.081976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0c0f9e79-ffaf-41a8-ae4d-7a4b8eb207f9 req-096c557b-a297-4cb3-8273-2670926d142e service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:12.082403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-0c0f9e79-ffaf-41a8-ae4d-7a4b8eb207f9 req-096c557b-a297-4cb3-8273-2670926d142e service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:12.094541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-0c0f9e79-ffaf-41a8-ae4d-7a4b8eb207f9 req-096c557b-a297-4cb3-8273-2670926d142e service nova] Creating event network-changed:667ef210-a872-48d3-9f05-d3c51aa59ec8 for instance ad62cc52-a7e1-4741-b34d-834be8297826 on hv-cinder-73306 Sep 01 07:49:12.099892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-0c0f9e79-ffaf-41a8-ae4d-7a4b8eb207f9 req-096c557b-a297-4cb3-8273-2670926d142e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032679 Sep 01 07:49:12.100588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1426/2869] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:49:12.207619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:12.208223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] [instance: 807e6a8a-bf4f-4892-b8e8-4039c7e96411] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:12.214516 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:12.215008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:12.215439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:12.216120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:12.216564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:12.216981 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:12.231277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] HTTP exception thrown: Instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 could not be found. Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Request method failure captured: Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 HTTP/1.1 Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEFvBFFWc6puLNPHy3F-IcgMhvUjqlMzltcrwUBajcvx1etWIhC2rrASYnuJiwBRHYoyD8sjqxApn2ay4Bz_snjhqHekqKNrQ35gssMqLakA1LiYaJ3o8-OnTjJW691ti3PrLANcHhrdA-DRzucAEK5xlDZeeZg7KGvIYpVA9rhtoR5Q Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: c1705474b7954cf1926e9beb2d548587 Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:49:12.232800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1705474b7954cf1926e9beb2d548587"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1705474b7954cf1926e9beb2d548587", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: c1705474b7954cf1926e9beb2d548587 Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-547052379 Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-ServerRescueNegativeTestJSON-547052379-project Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: db4f0928502a43b490de01afc587a846 Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-547052379-project Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 could not be found. Sep 01 07:49:12.235102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '807e6a8a-bf4f-4892-b8e8-4039c7e96411'} Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 could not be found. Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:49:12.236174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 could not be found. Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 could not be found. Sep 01 07:49:12.237968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:49:12.239528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] Returning 404 to user: Instance 807e6a8a-bf4f-4892-b8e8-4039c7e96411 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:49:12.239528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8931cb0b-4ae2-449a-b474-48276fb70152 tempest-ServerRescueNegativeTestJSON-547052379 tempest-ServerRescueNegativeTestJSON-547052379-project] 10.222.0.46 "GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411" status: 404 len: 111 microversion: 2.1 time: 0.030481 Sep 01 07:49:12.239528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1444/2870] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:12 2022] GET /compute/v2.1/servers/807e6a8a-bf4f-4892-b8e8-4039c7e96411 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:49:12.291150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1075871153", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-159046410", "security_groups": [{"name": "tempest-secgroup-smoke-659639042"}], "block_device_mapping_v2": [{"uuid": "1d8b1fcf-ebd8-4ca6-8067-65c16445ee47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12e730ee-3f90-4c7d-91ff-0643ead39468"}]}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:12.474008 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] validate_networks() for [('12e730ee-3f90-4c7d-91ff-0643ead39468', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:49:12.486221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:12.487442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:12.494409 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:12.494989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:12.495577 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:12.496482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:12.497019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:12.497592 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:12.813691 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:12.821463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4f05ba1-bc67-4eb0-8ecd-17bf98abd820 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1319 microversion: 2.1 time: 0.344345 Sep 01 07:49:12.822033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1445/2871] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:12 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:13.342394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:49:13.342911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:49:13.343285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:49:13.343694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:49:13.344107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:49:13.353635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:13.354121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:13.354567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:13.355295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:13.355756 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:13.356188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:13.373190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Getting quotas for project df5069d6a3a34a08bb00105a91251cf2. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:49:13.377603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Getting quotas for user 93b2cf587dc44209a186fc453ac5bdfc and project df5069d6a3a34a08bb00105a91251cf2. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:49:13.437822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:49:13.439970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1d8b1fcf-ebd8-4ca6-8067-65c16445ee47',volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:49:13.579928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6ecb768e-ddc3-4397-9436-4f4c0377424b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.293650 Sep 01 07:49:13.580791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1427/2872] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:49:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:49:13.591454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f7cb3c6-6781-4c70-b2e7-d138e7d21d29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:13.592199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f7cb3c6-6781-4c70-b2e7-d138e7d21d29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:13.691119 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f7cb3c6-6781-4c70-b2e7-d138e7d21d29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:13.698431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f7cb3c6-6781-4c70-b2e7-d138e7d21d29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1094 microversion: 2.1 time: 0.110901 Sep 01 07:49:13.698995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1446/2873] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:13 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1094 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:13.842582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:13.843203 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:13.849713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:13.850348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:13.850795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:13.852044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:13.852503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:13.852929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:14.329430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:14.343106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c0575ee-a7f0-47b8-8a99-275ab25b953f tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1319 microversion: 2.1 time: 0.504342 Sep 01 07:49:14.352886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1428/2874] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:13 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:14.717926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aee1dc56-1177-4dfe-8149-46fbb0ab8cc8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:14.718431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aee1dc56-1177-4dfe-8149-46fbb0ab8cc8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:14.805726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aee1dc56-1177-4dfe-8149-46fbb0ab8cc8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:14.813305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aee1dc56-1177-4dfe-8149-46fbb0ab8cc8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1094 microversion: 2.1 time: 0.099328 Sep 01 07:49:14.814089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1447/2875] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:14 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:15.368738 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:15.374469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:15.385266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:15.386050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:15.386569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:15.387353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:15.387899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:15.388563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:15.655815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:15.663455 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e4440cb2-4201-48ca-950d-f67d03859450 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1319 microversion: 2.1 time: 0.300818 Sep 01 07:49:15.663961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1429/2876] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:15 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:15.833709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c180b39-6c46-4e60-a3fe-3e469af580ef tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:15.835162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c180b39-6c46-4e60-a3fe-3e469af580ef tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:15.927889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c180b39-6c46-4e60-a3fe-3e469af580ef tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:15.940015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c180b39-6c46-4e60-a3fe-3e469af580ef tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1094 microversion: 2.1 time: 0.109981 Sep 01 07:49:15.941551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1448/2877] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:15 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:16.690300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:16.691039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:16.704763 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:16.705406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:16.705944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:16.706758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:16.707313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:16.708015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:16.923073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:16.932445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4150def5-b978-45c4-9d68-0da7554fa2a5 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1319 microversion: 2.1 time: 0.248838 Sep 01 07:49:16.932774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1430/2878] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:16 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:16.961379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:16.961986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:16.969487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:16.970250 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:16.970873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:16.971736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:16.972346 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:16.972930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:17.059682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:17.067452 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47161d84-46fe-4d52-ab4f-b03f683ab706 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1200 microversion: 2.1 time: 0.110424 Sep 01 07:49:17.068251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1449/2879] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:16 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1200 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:17.953262 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:17.954023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:17.971006 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:17.976844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:17.978153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:17.979277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:17.979900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:17.980458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:18.090613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:18.091320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:18.104067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:18.105076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:18.106931 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:18.108408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:18.109428 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:18.110614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:18.309755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:18.322628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e5336630-7721-4137-b193-befaed08a766 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1319 microversion: 2.1 time: 0.373654 Sep 01 07:49:18.323278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1431/2880] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:17 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:18.428139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:18.447244 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-309760c9-1add-4e97-9de6-bb17fde3ec7c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.354156 Sep 01 07:49:18.461599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1450/2881] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:18 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:18.557864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-90d6cdb4-742a-4ebb-8bf3-ff061e7a14c5 req-3db8de47-b1a5-4c88-9e6a-922050ba7e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad62cc52-a7e1-4741-b34d-834be8297826", "name": "network-vif-plugged", "status": "completed", "tag": "667ef210-a872-48d3-9f05-d3c51aa59ec8"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:18.568818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-90d6cdb4-742a-4ebb-8bf3-ff061e7a14c5 req-3db8de47-b1a5-4c88-9e6a-922050ba7e43 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:18.570093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-90d6cdb4-742a-4ebb-8bf3-ff061e7a14c5 req-3db8de47-b1a5-4c88-9e6a-922050ba7e43 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:18.570731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-90d6cdb4-742a-4ebb-8bf3-ff061e7a14c5 req-3db8de47-b1a5-4c88-9e6a-922050ba7e43 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:18.582890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-90d6cdb4-742a-4ebb-8bf3-ff061e7a14c5 req-3db8de47-b1a5-4c88-9e6a-922050ba7e43 service nova] Creating event network-vif-plugged:667ef210-a872-48d3-9f05-d3c51aa59ec8 for instance ad62cc52-a7e1-4741-b34d-834be8297826 on hv-cinder-73306 Sep 01 07:49:18.589285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-90d6cdb4-742a-4ebb-8bf3-ff061e7a14c5 req-3db8de47-b1a5-4c88-9e6a-922050ba7e43 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264429 Sep 01 07:49:18.589916 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1432/2882] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:18.840993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-fbfc1224-4784-45ca-af48-d76605a5f8a8 req-d96e6c67-4ac0-43e1-a80a-9fb96944a0de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5cefdc-d023-4097-bd9a-7b91c212112c", "tag": "8365188e-523d-4b45-a823-b4c65370574d"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:18.852774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fbfc1224-4784-45ca-af48-d76605a5f8a8 req-d96e6c67-4ac0-43e1-a80a-9fb96944a0de service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:18.853317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fbfc1224-4784-45ca-af48-d76605a5f8a8 req-d96e6c67-4ac0-43e1-a80a-9fb96944a0de service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:18.853746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fbfc1224-4784-45ca-af48-d76605a5f8a8 req-d96e6c67-4ac0-43e1-a80a-9fb96944a0de service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:18.866975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-fbfc1224-4784-45ca-af48-d76605a5f8a8 req-d96e6c67-4ac0-43e1-a80a-9fb96944a0de service nova] Creating event network-changed:8365188e-523d-4b45-a823-b4c65370574d for instance 9f5cefdc-d023-4097-bd9a-7b91c212112c on hv-cinder-73306 Sep 01 07:49:18.872568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-fbfc1224-4784-45ca-af48-d76605a5f8a8 req-d96e6c67-4ac0-43e1-a80a-9fb96944a0de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035208 Sep 01 07:49:18.873223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1451/2883] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:19.350558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:19.352585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:19.359900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:19.360774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:19.361476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:19.362892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:19.363619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:19.364215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:19.471985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:19.473397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:19.490985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:19.492169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:19.492689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:19.493574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:19.494242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:19.494832 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:19.978493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:19.980029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:19.992317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c34a569-8537-4b55-b0c7-bf4a301ce6c3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1319 microversion: 2.1 time: 0.645837 Sep 01 07:49:19.997446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1433/2884] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:19 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1319 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:20.000574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9a257c5-450e-410f-bee9-ee6de5224ee3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.534822 Sep 01 07:49:20.010410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1452/2885] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:19 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:21.019165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:21.019796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:21.028243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:21.028712 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:21.029212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:21.029892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:21.030348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:21.030880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:21.037933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:21.042135 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:21.074132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:21.080665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:21.081260 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:21.082077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:21.083971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:21.084472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:21.618723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:21.629168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4c88af02-ec52-495f-8459-d299220b0c5c tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1508 microversion: 2.1 time: 0.616312 Sep 01 07:49:21.629881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1434/2886] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:21 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1508 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:21.651327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ca5e640-b62c-4dc4-95ed-1bca5cbe0dda", "device": "/dev/sdb"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:21.654614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:21.661300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:21.661788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:21.662435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:21.663341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:21.663981 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:21.664565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:21.741963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:21.758888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bfc89f84-6cb6-4c3b-8160-1ae20d6de78b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.741348 Sep 01 07:49:21.761739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1453/2887] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:21 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:21.785581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:22.025419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9fa42a4-8303-427a-8d9e-089fb4d5b478 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "POST /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378503 Sep 01 07:49:22.026080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1435/2888] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:49:21 2022] POST /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:22.785108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:22.785946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:22.799842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:22.801421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:22.805191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:22.806402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:22.808202 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:22.810357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:23.123939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:23.137886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62bd8f34-aaee-49bf-85ae-59bbfc897314 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.357687 Sep 01 07:49:23.151934 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1454/2889] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:22 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:24.023814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:24.025675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=18 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:24.160143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:24.160814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:24.168914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:24.169362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:24.169797 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:24.170582 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:24.171037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:24.171580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:24.176494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9a7c61c7-cea2-49c1-99b8-bbe43d1911de tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'create', calling method: .version_select at 0x7f78cf1d1280>, body: {"keypair": {"name": "tempest-keypair-309775656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFrWOLPbhE26h1nodwBshWTVqq8qtC0w2MefmUmeYq5M9gE64FJ+y9Ai3D3GmCtAns7nKYyiOlYm7Z5o7d8Nh/7bfcUvhUwpzMP94fi3BemjaGbcXUIxBE1xBT95USTqw=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:24.193901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9a7c61c7-cea2-49c1-99b8-bbe43d1911de tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Getting quotas for project 6a0433dc28924fc891b5e114c521bb57. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:49:24.198610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-9a7c61c7-cea2-49c1-99b8-bbe43d1911de tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Getting quotas for user 4496d5005b0040e8b70020740e9e3401 and project 6a0433dc28924fc891b5e114c521bb57. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:49:24.209971 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:24.231300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9a7c61c7-cea2-49c1-99b8-bbe43d1911de tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.214487 Sep 01 07:49:24.238653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1436/2890] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:49:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:49:24.315948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:24.324370 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c801d671-7dde-4020-ae6c-a79e931734eb tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.168147 Sep 01 07:49:24.324947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1455/2891] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:24 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:25.356312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:25.358874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:25.372144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:25.373688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:25.374273 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:25.375183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:25.375897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:25.376592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:25.583831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:25.596502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b666379-6261-49bd-b02d-3c4018eb37c7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.245228 Sep 01 07:49:25.597699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1437/2892] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:25 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:25.780210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1699700736", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8d5567c-fd2e-4a88-9e08-ba44f06c1010"}], "security_groups": [{"name": "tempest-securitygroup--277317507"}], "key_name": "tempest-keypair-309775656", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:25.895455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] validate_networks() for [('f8d5567c-fd2e-4a88-9e08-ba44f06c1010', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:49:25.939839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:26.618201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:26.619510 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:26.627134 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:26.627315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:26.627961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:26.628610 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:26.629068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:26.629515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:26.888740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:26.899093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-97c21d2f-f3e3-4866-842c-3727a16416ec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.285198 Sep 01 07:49:26.900534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1438/2893] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:26 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:26.904100 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:49:26.905071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:49:26.905704 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:49:26.906240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:49:26.906810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:49:26.920394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:26.920866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:26.921543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:26.922387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:26.922963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:26.923524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:26.941390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Getting quotas for project 6a0433dc28924fc891b5e114c521bb57. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:49:26.946400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Getting quotas for user 4496d5005b0040e8b70020740e9e3401 and project 6a0433dc28924fc891b5e114c521bb57. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:49:26.958285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:49:26.961319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:49:27.011095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-caa8cdc3-1997-48e5-be0c-295d04fcf1f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.236860 Sep 01 07:49:27.011722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1456/2894] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:49:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:49:27.022668 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-74f4f125-2899-43c7-950a-27c872716448 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:27.023636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-74f4f125-2899-43c7-950a-27c872716448 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:27.090100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-74f4f125-2899-43c7-950a-27c872716448 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:27.102910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-74f4f125-2899-43c7-950a-27c872716448 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1237 microversion: 2.1 time: 0.084092 Sep 01 07:49:27.103491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1439/2895] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:27 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:27.922700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:27.923292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:27.932927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:27.933739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:27.934181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:27.934908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:27.935520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:27.936868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:27.942463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:28.089628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:28.097213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f881daef-4e6d-4f62-8621-74be62811ab0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.180656 Sep 01 07:49:28.097778 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1457/2896] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:27 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:28.123175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:28.123881 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:28.130789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:28.131281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:28.131726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:28.132951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:28.133493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:28.133930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:28.194194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:28.202233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-83c7f6c9-7420-460c-bb03-9a674c05aac1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1289 microversion: 2.1 time: 0.082846 Sep 01 07:49:28.202802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1440/2897] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:28 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:29.119544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:29.120726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:29.127913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:29.128384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:29.128810 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:29.129518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:29.129959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:29.130378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:29.223213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:29.223827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:29.230728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:29.231215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:29.231647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:29.232352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:29.232788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:29.233251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:29.307382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:29.315286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b6b12f01-934e-4b08-9c78-9b465db9372b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1295 microversion: 2.1 time: 0.095898 Sep 01 07:49:29.315985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1441/2898] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:29 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:29.325471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:29.333761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-283b6426-4101-4ccc-b096-366c5ebb4f09 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.219223 Sep 01 07:49:29.334318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1458/2899] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:29 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:30.336112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:30.336726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:30.343905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:30.344518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:30.345142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:30.345985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:30.346780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:30.347445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:30.355335 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:30.356564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:30.363925 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:30.364645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:30.365251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:30.366077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:30.367304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:30.367732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:30.643596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:30.652204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-01e24d90-7fdd-4b42-bfe3-257595028d42 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.320224 Sep 01 07:49:30.653289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1442/2900] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:30 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:30.654871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:30.675312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-959c6d5a-8c8c-4d91-aced-9f82f8a9cd02 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.325003 Sep 01 07:49:30.676221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1459/2901] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:30 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:30.744300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-da4ac669-4ddc-43f7-8ee1-ecf27d009990 req-d38afdb5-e875-4bb7-ba93-e6df4cacaced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de81900-cf33-47d8-be99-069ba32f748b", "tag": "cdaa9c7a-b03d-4c22-a6f3-072d8f312946"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:30.753518 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-da4ac669-4ddc-43f7-8ee1-ecf27d009990 req-d38afdb5-e875-4bb7-ba93-e6df4cacaced service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:30.754003 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-da4ac669-4ddc-43f7-8ee1-ecf27d009990 req-d38afdb5-e875-4bb7-ba93-e6df4cacaced service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:30.754428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-da4ac669-4ddc-43f7-8ee1-ecf27d009990 req-d38afdb5-e875-4bb7-ba93-e6df4cacaced service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:30.765313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-da4ac669-4ddc-43f7-8ee1-ecf27d009990 req-d38afdb5-e875-4bb7-ba93-e6df4cacaced service nova] Creating event network-changed:cdaa9c7a-b03d-4c22-a6f3-072d8f312946 for instance 3de81900-cf33-47d8-be99-069ba32f748b on hv-cinder-73306 Sep 01 07:49:30.770173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-da4ac669-4ddc-43f7-8ee1-ecf27d009990 req-d38afdb5-e875-4bb7-ba93-e6df4cacaced service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029449 Sep 01 07:49:30.770774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1443/2902] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:31.674853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:31.675464 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:31.683366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:31.683845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:31.684277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:31.684965 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:31.685434 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:31.685853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:31.697211 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:31.697808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:31.705300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:31.705792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:31.706223 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:31.706913 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:31.707360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:31.707775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:31.885604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:31.894943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35f2ce55-33c8-4bd5-9290-0c0e38b039a6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.223926 Sep 01 07:49:31.895513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1460/2903] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:31 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:31.899631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:31.907406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d2884e3b-cf94-49cd-aa24-941df66b2685 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.215325 Sep 01 07:49:31.907960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1444/2904] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:31 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:32.915521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:32.916128 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:32.918439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:32.923676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:32.924157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:32.924597 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:32.925316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:32.925768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:32.926189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:32.928372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:32.929095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:32.935388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:32.935867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:32.936303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:32.936991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:32.937471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:32.937898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:33.122628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:33.127237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:33.130199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80f725d9-edbe-493e-b8e9-dc11e77e4347 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.218480 Sep 01 07:49:33.130762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1461/2905] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:32 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:33.135466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1acfda31-f280-4d51-9b35-071a50f6f830 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.211101 Sep 01 07:49:33.136181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1445/2906] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:32 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:34.155559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:34.156174 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:34.159470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:34.160290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:34.164389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:34.164881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:34.165387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:34.166602 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:34.167423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:34.167777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:34.168188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:34.168453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:34.168891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:34.169767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:34.170464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:34.171026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:34.388152 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:34.391899 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:34.395878 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-76c6633a-d125-43aa-b827-97410c99bfb0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.249387 Sep 01 07:49:34.396558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1462/2907] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:34 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:34.400012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3211b750-ed10-4112-a8cd-aae6165846e8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.244632 Sep 01 07:49:34.400581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1446/2908] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:34 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:35.416848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:35.417490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:35.420543 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:35.421349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:35.424010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:35.424507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:35.424952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:35.425665 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:35.426111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:35.426532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:35.430613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:35.432679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:35.433534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:35.434065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:35.434535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:35.434963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:35.646425 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:35.651103 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:35.654562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5cf9ac4-c24e-48ae-b1be-c58d21507413 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.242113 Sep 01 07:49:35.655133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1463/2909] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:35 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:35.659270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ff12e6b-8a40-4e4b-8f26-95f8dca19f46 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.243299 Sep 01 07:49:35.659852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1447/2910] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:35 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:36.676962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:36.677611 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:36.678882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:36.680107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:36.684695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:36.685199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:36.685631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:36.686312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:36.686757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:36.686851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:36.687173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:36.687277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:36.687698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:36.688397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:36.688858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:36.689495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:36.873108 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:36.880624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35307302-dc17-4b52-a1c7-36f6dd8037d0 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.207471 Sep 01 07:49:36.881219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1464/2911] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:36 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:36.885702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:36.893364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c2a5943c-936c-4fe5-b7cb-f813c92966d7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.218287 Sep 01 07:49:36.893917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1448/2912] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:36 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:37.901319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:37.901923 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:37.903760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:37.904553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:37.910654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:37.911139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:37.911572 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:37.912252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:37.912699 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:37.913203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:37.914682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:37.915289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:37.917317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:37.923312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:37.924088 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:37.924545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:37.925287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:37.925748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:37.926180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:38.109633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:38.114651 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:38.117480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-585398b5-2278-4e38-a43d-fdf807362b1c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.220264 Sep 01 07:49:38.118131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1465/2913] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:37 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:38.122352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f7ba54d5-f869-45ed-a8d0-ab7472bc3253 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.211997 Sep 01 07:49:38.122909 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1449/2914] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:37 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:39.136828 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:39.137492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:39.142667 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:39.143279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:39.143901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:39.144381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:39.144818 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:39.145530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:39.145976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:39.146400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:39.150304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:39.150793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:39.151232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:39.151925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:39.152394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:39.152820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:39.338771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:39.342440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:39.346328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-998adf98-7cf1-4ddd-a087-30d8f8e1c5f7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.213312 Sep 01 07:49:39.346889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1466/2915] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:39 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:39.350095 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8cd96ece-f3a9-4bc2-a13b-e87dcdb3108f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.211163 Sep 01 07:49:39.350656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1450/2916] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:39 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:39.602130 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-21378a1f-881f-49ad-8529-3e2a6d2cde38 req-3feb4e98-544c-4a67-93fd-e1c6f20e7b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5cefdc-d023-4097-bd9a-7b91c212112c", "name": "network-vif-plugged", "status": "completed", "tag": "8365188e-523d-4b45-a823-b4c65370574d"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:39.611840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-21378a1f-881f-49ad-8529-3e2a6d2cde38 req-3feb4e98-544c-4a67-93fd-e1c6f20e7b1b service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:39.612461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-21378a1f-881f-49ad-8529-3e2a6d2cde38 req-3feb4e98-544c-4a67-93fd-e1c6f20e7b1b service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:39.612904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-21378a1f-881f-49ad-8529-3e2a6d2cde38 req-3feb4e98-544c-4a67-93fd-e1c6f20e7b1b service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:39.624033 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-21378a1f-881f-49ad-8529-3e2a6d2cde38 req-3feb4e98-544c-4a67-93fd-e1c6f20e7b1b service nova] Creating event network-vif-plugged:8365188e-523d-4b45-a823-b4c65370574d for instance 9f5cefdc-d023-4097-bd9a-7b91c212112c on hv-cinder-73306 Sep 01 07:49:39.628949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-21378a1f-881f-49ad-8529-3e2a6d2cde38 req-3feb4e98-544c-4a67-93fd-e1c6f20e7b1b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030542 Sep 01 07:49:39.629565 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1467/2917] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:40.367265 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:40.367897 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:40.371530 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:40.372284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:40.374392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:40.374875 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:40.375320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:40.376014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:40.376473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:40.376901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:40.378398 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:40.378867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:40.379367 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:40.380040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:40.380926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:40.380926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:40.617686 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:40.625315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-838ecf14-59a2-4fb2-aeb2-b3674ea79fd3 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.262538 Sep 01 07:49:40.625645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:40.625882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1451/2918] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:40 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:40.633204 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cc4e1eae-4d0d-4dad-9641-3c963564ebb3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1265 microversion: 2.1 time: 0.266878 Sep 01 07:49:40.633758 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1468/2919] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:40 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:41.645292 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:41.645905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:41.653937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:41.654500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:41.654728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:41.655152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:41.655586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:41.656349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:41.656898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:41.657467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:41.666377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:41.666910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:41.667541 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:41.668241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:41.668686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:41.669180 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:41.879457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:41.896899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:41.902986 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b0ff822-9540-4fe1-8dab-b94a6eef1bc1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.261602 Sep 01 07:49:41.903569 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1452/2920] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:41 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:41.906568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-649c01c5-9ff2-4e8e-b7cb-bb404f9576b6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1451 microversion: 2.1 time: 0.256365 Sep 01 07:49:41.909189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1469/2921] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:41 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1451 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:41.927743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:41.928880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:41.936223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:41.936749 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:41.937275 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:41.937969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:41.938423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:41.939605 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:42.084686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:42.092324 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83171e0b-5001-4977-9211-a4ea6f99fe29 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1451 microversion: 2.1 time: 0.169604 Sep 01 07:49:42.092998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1470/2922] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:41 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:42.923079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:42.924344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:42.931485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:42.931982 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:42.932417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:42.933137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:42.933759 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:42.934187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:43.151960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:43.155830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:43.161766 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9f82344f-bc40-479b-a3a4-583ef176c27f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.242461 Sep 01 07:49:43.162586 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1453/2923] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:42 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:43.831331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:43.832740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:43.841447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:43.842601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:43.843315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:43.844323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:43.845299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:43.845929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:43.972181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lazy-loading 'services' on Instance uuid ad62cc52-a7e1-4741-b34d-834be8297826 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:49:44.062246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c5427e1-b966-4f26-9622-9b47bcf2e66b tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826/os-volume_attachments/1ca5e640-b62c-4dc4-95ed-1bca5cbe0dda" status: 202 len: 0 microversion: 2.1 time: 0.234129 Sep 01 07:49:44.063587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1471/2924] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:49:43 2022] DELETE /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826/os-volume_attachments/1ca5e640-b62c-4dc4-95ed-1bca5cbe0dda => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:49:44.115626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-14fd3b40-afe0-413c-bc87-bb133f991832 req-5d7e334c-2710-42ff-9fd9-25549b896ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de81900-cf33-47d8-be99-069ba32f748b", "name": "network-vif-plugged", "status": "completed", "tag": "cdaa9c7a-b03d-4c22-a6f3-072d8f312946"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:44.131438 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-14fd3b40-afe0-413c-bc87-bb133f991832 req-5d7e334c-2710-42ff-9fd9-25549b896ab0 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:44.133425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-14fd3b40-afe0-413c-bc87-bb133f991832 req-5d7e334c-2710-42ff-9fd9-25549b896ab0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:44.134351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-14fd3b40-afe0-413c-bc87-bb133f991832 req-5d7e334c-2710-42ff-9fd9-25549b896ab0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:44.166729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-14fd3b40-afe0-413c-bc87-bb133f991832 req-5d7e334c-2710-42ff-9fd9-25549b896ab0 service nova] Creating event network-vif-plugged:cdaa9c7a-b03d-4c22-a6f3-072d8f312946 for instance 3de81900-cf33-47d8-be99-069ba32f748b on hv-cinder-73306 Sep 01 07:49:44.173911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-14fd3b40-afe0-413c-bc87-bb133f991832 req-5d7e334c-2710-42ff-9fd9-25549b896ab0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062303 Sep 01 07:49:44.175009 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1454/2925] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:44.185085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:44.187054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:44.211379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:44.212134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:44.212992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:44.214009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:44.215286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:44.215895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:44.455055 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:44.466197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-dc44204f-9055-4636-9a60-15d54be6d9b3 req-730e88f2-d27c-40bc-948a-a288a62b7f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5cefdc-d023-4097-bd9a-7b91c212112c", "tag": "8365188e-523d-4b45-a823-b4c65370574d"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:44.469926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ac8786a-9f10-4d54-bf9d-706157a97d01 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.288336 Sep 01 07:49:44.477715 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-dc44204f-9055-4636-9a60-15d54be6d9b3 req-730e88f2-d27c-40bc-948a-a288a62b7f07 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:44.478197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-dc44204f-9055-4636-9a60-15d54be6d9b3 req-730e88f2-d27c-40bc-948a-a288a62b7f07 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:44.478822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-dc44204f-9055-4636-9a60-15d54be6d9b3 req-730e88f2-d27c-40bc-948a-a288a62b7f07 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:44.485486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1472/2926] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:44 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:44.495405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-dc44204f-9055-4636-9a60-15d54be6d9b3 req-730e88f2-d27c-40bc-948a-a288a62b7f07 service nova] Creating event network-changed:8365188e-523d-4b45-a823-b4c65370574d for instance 9f5cefdc-d023-4097-bd9a-7b91c212112c on hv-cinder-73306 Sep 01 07:49:44.501449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-dc44204f-9055-4636-9a60-15d54be6d9b3 req-730e88f2-d27c-40bc-948a-a288a62b7f07 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039002 Sep 01 07:49:44.502356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1455/2927] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:49:45.221732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:45.222221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:45.229644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:45.230118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:45.230543 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:45.231408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:45.232029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:45.232446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:45.261320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:49:45.265507 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:49:45.352874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1691b5b-9f8b-4378-bb40-2416397a3970 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 204 len: 0 microversion: 2.1 time: 0.134582 Sep 01 07:49:45.354149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1473/2928] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:49:45 2022] DELETE /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:49:45.363111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:45.364871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:45.381169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:45.387274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:45.389872 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:45.391891 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:45.392548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:45.393264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:45.499648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:45.500783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:45.507327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:45.508352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:45.508767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:45.509805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:45.510427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:45.511131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:45.656074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:45.666608 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-da4e29fe-c449-4d38-bf79-6687693110af tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1514 microversion: 2.1 time: 0.307346 Sep 01 07:49:45.667867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1456/2929] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:45 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:45.702823 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:45.710599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97e150b8-d2ff-4fcd-8a65-b1e82422a9d6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.222937 Sep 01 07:49:45.713170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1474/2930] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:45 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:46.687131 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:46.687751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:46.694520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:46.695010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:46.695446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:46.696143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:46.696597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:46.697032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:46.731959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:46.732479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:46.738767 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:46.739421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:46.739861 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:46.740519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:46.740961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:46.741613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:46.906402 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:46.915143 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-069cdad0-6f87-4c06-ba1c-cd24324f9865 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1514 microversion: 2.1 time: 0.231743 Sep 01 07:49:46.916408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1457/2931] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:46 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:46.935675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:46.943245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0282298a-a151-4726-9d56-e656836f13c7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1362 microversion: 2.1 time: 0.215118 Sep 01 07:49:46.943840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1475/2932] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:46 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:49:47.936471 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:47.937186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:47.943656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:47.944141 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:47.944574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:47.945290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:47.945743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:47.946195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:47.966915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:47.967521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:47.974628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:47.975113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:47.975542 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:47.976221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:47.976813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:47.978179 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:48.139464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:48.147580 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d96ab823-e3ec-430f-84cb-928177c14f31 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1514 microversion: 2.1 time: 0.215063 Sep 01 07:49:48.148229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1458/2933] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:47 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:48.154262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:48.162429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67a12dc9-2910-419f-87c0-467ad5b49154 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1548 microversion: 2.1 time: 0.199431 Sep 01 07:49:48.163071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1476/2934] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:47 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:48.184404 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:48.184969 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:48.191229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:48.191808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:48.192216 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:48.192914 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:48.193409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:48.193841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:48.276285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dbacdf06-7e00-408f-8ee4-6870e93ee786 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096263 Sep 01 07:49:48.276883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1459/2935] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 07:49:48 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:49:49.169474 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:49.170215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:49.176706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:49.177217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:49.177645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:49.178332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:49.178816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:49.179236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:49.244195 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-12266a00-1eb9-4bbd-9468-5a582c551ff2 req-74eacc71-291b-4149-b6a0-d9059ab554ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad62cc52-a7e1-4741-b34d-834be8297826", "name": "network-vif-deleted", "tag": "667ef210-a872-48d3-9f05-d3c51aa59ec8"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:49.257480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-12266a00-1eb9-4bbd-9468-5a582c551ff2 req-74eacc71-291b-4149-b6a0-d9059ab554ac service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:49.257965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-12266a00-1eb9-4bbd-9468-5a582c551ff2 req-74eacc71-291b-4149-b6a0-d9059ab554ac service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:49.258398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-12266a00-1eb9-4bbd-9468-5a582c551ff2 req-74eacc71-291b-4149-b6a0-d9059ab554ac service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:49.271049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a74f33e6e941ed8c3f7850bdf29bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7170a1232ab14cd4aff705e91364d5c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:49:49.272309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-12266a00-1eb9-4bbd-9468-5a582c551ff2 req-74eacc71-291b-4149-b6a0-d9059ab554ac service nova] Creating event network-vif-deleted:667ef210-a872-48d3-9f05-d3c51aa59ec8 for instance ad62cc52-a7e1-4741-b34d-834be8297826 on hv-cinder-73306 Sep 01 07:49:49.279832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-12266a00-1eb9-4bbd-9468-5a582c551ff2 req-74eacc71-291b-4149-b6a0-d9059ab554ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038894 Sep 01 07:49:49.280619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1460/2936] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:49:49.281558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58face11-5c09-476e-a59c-c28ab6081cca tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 200 len: 1472 microversion: 2.1 time: 0.115919 Sep 01 07:49:49.282585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1477/2937] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:49 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 1472 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:49:50.303375 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:49:50.304071 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] [instance: ad62cc52-a7e1-4741-b34d-834be8297826] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:49:50.310359 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:50.310837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:50.311271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:50.311951 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:50.312399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:50.312820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:50.326136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] HTTP exception thrown: Instance ad62cc52-a7e1-4741-b34d-834be8297826 could not be found. Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Request method failure captured: Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 HTTP/1.1 Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEFxsq7AhL__ZbkBMFFQ8QO5swP76HAnzZN4vwPNtf_QFnBptpWuPz3xMrU23DKRg2YuV_NKM5TDS_WhLWBToVw3Z5iWDUaY2a3wyiYCRsEn3xnVkrHinIFwgrzZMddfD8Ea0Tdt0B6MXpDkWTlzZfT2sP8t4c_rsM6sqzHeJYJalbSY Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 7170a1232ab14cd4aff705e91364d5c1 Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1159241706 Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:49:50.327642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7170a1232ab14cd4aff705e91364d5c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7170a1232ab14cd4aff705e91364d5c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7170a1232ab14cd4aff705e91364d5c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7170a1232ab14cd4aff705e91364d5c1", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-VolumesSnapshotTestJSON-1159241706 Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 7170a1232ab14cd4aff705e91364d5c1 Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1159241706 Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-VolumesSnapshotTestJSON-1159241706-project Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: c6a74f33e6e941ed8c3f7850bdf29bb0 Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-VolumesSnapshotTestJSON-1159241706-project Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance ad62cc52-a7e1-4741-b34d-834be8297826 could not be found. Sep 01 07:49:50.328719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': 'ad62cc52-a7e1-4741-b34d-834be8297826'} Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad62cc52-a7e1-4741-b34d-834be8297826 could not be found. Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:49:50.329403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad62cc52-a7e1-4741-b34d-834be8297826 could not be found. Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad62cc52-a7e1-4741-b34d-834be8297826 could not be found. Sep 01 07:49:50.330394 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:49:50.331260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] Returning 404 to user: Instance ad62cc52-a7e1-4741-b34d-834be8297826 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:49:50.331260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b288b438-f13f-4c4a-870b-2f63fedb81f3 tempest-VolumesSnapshotTestJSON-1159241706 tempest-VolumesSnapshotTestJSON-1159241706-project] 10.222.0.46 "GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826" status: 404 len: 111 microversion: 2.1 time: 0.030401 Sep 01 07:49:50.331260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1461/2938] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:49:50 2022] GET /compute/v2.1/servers/ad62cc52-a7e1-4741-b34d-834be8297826 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:49:51.299668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-cb823576-722e-4738-99fb-b9c2d3a7ee36 req-e9fdf7e0-038a-44af-88cf-9e79495ae183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de81900-cf33-47d8-be99-069ba32f748b", "tag": "cdaa9c7a-b03d-4c22-a6f3-072d8f312946"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:49:51.309880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-cb823576-722e-4738-99fb-b9c2d3a7ee36 req-e9fdf7e0-038a-44af-88cf-9e79495ae183 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:49:51.310345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-cb823576-722e-4738-99fb-b9c2d3a7ee36 req-e9fdf7e0-038a-44af-88cf-9e79495ae183 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:49:51.310766 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-cb823576-722e-4738-99fb-b9c2d3a7ee36 req-e9fdf7e0-038a-44af-88cf-9e79495ae183 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:49:51.321938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-cb823576-722e-4738-99fb-b9c2d3a7ee36 req-e9fdf7e0-038a-44af-88cf-9e79495ae183 service nova] Creating event network-changed:cdaa9c7a-b03d-4c22-a6f3-072d8f312946 for instance 3de81900-cf33-47d8-be99-069ba32f748b on hv-cinder-73306 Sep 01 07:49:51.327083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-cb823576-722e-4738-99fb-b9c2d3a7ee36 req-e9fdf7e0-038a-44af-88cf-9e79495ae183 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031189 Sep 01 07:49:51.327712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1478/2939] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:50:33.613482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:33.614212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:33.616228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:50:33.616857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=30 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:50:33.623602 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:33.624076 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:33.624507 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:33.625214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:33.625663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:33.626085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:33.650412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4e2e0e12-5a8e-45f2-b9af-7c05b4b032ff tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/ips" status: 200 len: 145 microversion: 2.1 time: 0.040758 Sep 01 07:50:33.650976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1462/2940] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:50:33 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:50:36.036059 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:50:36.036822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:50:36.041554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a06338a2-9621-476c-ba1b-901713e68499"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:50:36.044480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:36.053405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:36.053889 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:36.054327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:36.055018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:36.055475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:36.055902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:36.319296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f73a035-019f-4d77-922d-6eecaab4f246 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284735 Sep 01 07:50:36.319888 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1479/2941] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:50:36 2022] POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:50:43.837555 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0ba2c42-dd86-49d7-8c7a-2b1c68223a88 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:50:43.841053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:50:43.841730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=4 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:50:43.849179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ba2c42-dd86-49d7-8c7a-2b1c68223a88 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:43.849671 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ba2c42-dd86-49d7-8c7a-2b1c68223a88 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:43.850118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ba2c42-dd86-49d7-8c7a-2b1c68223a88 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:43.909486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0ba2c42-dd86-49d7-8c7a-2b1c68223a88 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Going to try to stop instance {{(pid=120638) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 07:50:43.950519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0ba2c42-dd86-49d7-8c7a-2b1c68223a88 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/action" status: 202 len: 0 microversion: 2.1 time: 0.116825 Sep 01 07:50:43.951111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1463/2942] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:50:43 2022] POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:50:43.957134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:50:43.957620 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Thu Sep 1 07:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b (ip 10.222.0.46) !!! Sep 01 07:50:43.962356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:43.963134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:43.971510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:43.972066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:43.972566 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:43.973285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:43.973728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:43.974197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:44.105696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:44.113998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d7f8624-632e-4e79-9def-e14217e0be78 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.158328 Sep 01 07:50:44.114557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1480/2943] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:43 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:45.136243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:45.137606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:45.143631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:45.144107 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:45.144541 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:45.145245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:45.145693 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:45.146114 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:45.386673 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:45.394754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fece3f31-67fb-42c8-96db-c391765020e6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.263262 Sep 01 07:50:45.395315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1464/2944] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:45 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:46.415120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:46.415723 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:46.422253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:46.422726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:46.423156 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:46.423833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:46.424278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:46.424696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:46.551411 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:46.559886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f8c007ac-a620-466c-bc24-00bb2575a1cd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.148660 Sep 01 07:50:46.560446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1481/2945] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:46 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:47.580627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:47.581319 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:47.587762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:47.588242 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:47.588675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:47.589388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:47.589864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:47.590281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:47.717833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:47.726409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-afe7a397-1568-4a6d-8694-bffddf8a6125 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.149614 Sep 01 07:50:47.726970 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1465/2946] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:47 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:48.751759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:48.752361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:48.758728 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:48.759200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:48.759627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:48.760304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:48.760745 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:48.761212 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:48.885960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:48.893998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9ac7b57-fd90-4b75-900a-3cc96bb410df tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.146146 Sep 01 07:50:48.894562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1482/2947] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:48 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:49.914890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:49.915498 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:49.922295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:49.922777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:49.923210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:49.923892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:49.924341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:49.924762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:50.051790 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:50.060432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d605fb08-bd69-4fff-b65d-035f8746a08e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.149371 Sep 01 07:50:50.060988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1466/2948] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:49 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:51.081558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:51.082164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:51.088483 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:51.088956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:51.089414 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:51.090091 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:51.090534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:51.090951 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:51.218435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:51.226466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c60a19a-603d-4370-a0e4-e782d7b0075a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.148765 Sep 01 07:50:51.227032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1483/2949] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:51 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:52.247730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:52.248341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:52.254762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:52.255244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:52.255684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:52.256367 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:52.256818 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:52.257278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:52.384578 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:52.393309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9527052-100e-4182-a989-5565a295eec4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.149407 Sep 01 07:50:52.393867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1467/2950] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:52 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:53.413444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:53.414042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:53.420905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:53.421405 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:53.421830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:53.422500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:53.422941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:53.423354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:53.551885 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:53.559936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b1685409-3f54-4ed8-8b64-a796728bcaee tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.150311 Sep 01 07:50:53.560487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1484/2951] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:53 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:54.580034 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:54.580642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:54.587129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:54.587609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:54.588040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:54.588722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:54.589187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:54.590123 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:54.713517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:54.722100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b21209ec-19c9-4ce1-8407-0d55f63d341e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.145921 Sep 01 07:50:54.722655 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1468/2952] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:54 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:55.745756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:55.746279 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:55.752607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:55.753076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:55.753536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:55.754206 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:55.754644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:55.755056 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:55.881830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:55.890379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c07b9864-7d08-40e5-a123-b8e11ce8b8b9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.148504 Sep 01 07:50:55.890945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1485/2953] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:55 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:56.912054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:56.912652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:56.919561 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:56.920036 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:56.920467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:56.921166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:56.921617 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:56.922050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:57.049389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:57.059605 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f552c053-2533-4c18-87d3-4e62a192cc3e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.151317 Sep 01 07:50:57.060179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1469/2954] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:56 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:58.079774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:58.080376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:58.086806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:58.087280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:58.087710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:58.088381 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:58.088825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:58.089282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:58.215045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:58.223045 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-823a90e0-039e-4600-b579-cdd837f3b0cf tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.147126 Sep 01 07:50:58.223601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1486/2955] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:58 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:50:59.244425 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:50:59.245038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:50:59.251925 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:59.252407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:59.252844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:59.253563 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:50:59.254017 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:50:59.254442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:50:59.384754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:50:59.393544 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-621251c2-a0fb-4a2a-956e-57085750a5ba tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1722 microversion: 2.1 time: 0.152884 Sep 01 07:50:59.394104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1470/2956] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:50:59 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:00.415844 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:00.417106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:00.424043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:00.424523 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:00.424955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:00.425676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:00.426121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:00.426539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:00.556685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:00.564714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36646953-459b-44ac-8fd8-ed792f858636 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1699 microversion: 2.1 time: 0.152818 Sep 01 07:51:00.565307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1487/2957] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:00 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:00.584702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-65f314c5-2759-4d26-aab9-ba8005a8f35b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:51:00.590685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f314c5-2759-4d26-aab9-ba8005a8f35b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:00.591692 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f314c5-2759-4d26-aab9-ba8005a8f35b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:00.592124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-65f314c5-2759-4d26-aab9-ba8005a8f35b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:00.613954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-65f314c5-2759-4d26-aab9-ba8005a8f35b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Going to try to start instance {{(pid=120638) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 07:51:00.654542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-65f314c5-2759-4d26-aab9-ba8005a8f35b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/action" status: 202 len: 0 microversion: 2.1 time: 0.073325 Sep 01 07:51:00.655117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1471/2958] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:51:00 2022] POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:51:00.663194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:00.663802 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:00.670218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:00.670640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:00.671132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:00.671742 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:00.672224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:00.672677 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:00.820397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:00.828710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d96f5856-e3e5-4b4c-accd-ad7d881e6567 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1708 microversion: 2.1 time: 0.169319 Sep 01 07:51:00.829310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1488/2959] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:00 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:01.851018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:01.851748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:01.858324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:01.858807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:01.859244 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:01.859934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:01.860387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:01.860808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:01.987435 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:01.995554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b1b53ca3-fb5f-4680-b245-3c9c86f2085a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1708 microversion: 2.1 time: 0.149210 Sep 01 07:51:01.996119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1472/2960] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:01 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:03.017276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:03.017935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:03.024533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:03.025010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:03.025469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:03.026143 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:03.026587 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:03.027005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:03.154172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:03.162245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8d0a9d70-156e-49ae-ba51-b3e93aec0f25 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1712 microversion: 2.1 time: 0.149441 Sep 01 07:51:03.162809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1489/2961] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:03 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1712 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:38.304466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:38.305171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:38.307126 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=20 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:51:38.307767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:51:38.313603 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:38.314087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:38.314531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:38.315315 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:38.315672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:38.316094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:38.396027 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lazy-loading 'services' on Instance uuid 3de81900-cf33-47d8-be99-069ba32f748b {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:51:38.465903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-141b13c3-9ecf-480d-af62-375c91a545f2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/os-volume_attachments/a06338a2-9621-476c-ba1b-901713e68499" status: 202 len: 0 microversion: 2.1 time: 0.165381 Sep 01 07:51:38.467118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1473/2962] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:51:38 2022] DELETE /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/os-volume_attachments/a06338a2-9621-476c-ba1b-901713e68499 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:51:39.585640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a5dd3f3-d7c5-4097-b893-ef4759815e3c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:51:39.587686 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=22 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:51:39.588446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:51:39.594390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a5dd3f3-d7c5-4097-b893-ef4759815e3c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:39.594865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a5dd3f3-d7c5-4097-b893-ef4759815e3c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:39.595320 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a5dd3f3-d7c5-4097-b893-ef4759815e3c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:39.656807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a5dd3f3-d7c5-4097-b893-ef4759815e3c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Going to try to stop instance {{(pid=120637) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 07:51:39.698317 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a5dd3f3-d7c5-4097-b893-ef4759815e3c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/action" status: 202 len: 0 microversion: 2.1 time: 0.116750 Sep 01 07:51:39.698905 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1490/2963] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:51:39 2022] POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:51:39.708942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:39.709663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:39.716183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:39.716723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:39.717163 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:39.717857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:39.718306 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:39.718729 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:39.847946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:39.855834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-85a95285-65f7-4e87-8c29-fead1257fcea tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1676 microversion: 2.1 time: 0.151843 Sep 01 07:51:39.856398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1474/2964] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:39 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:40.877712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:40.878455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:40.884534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:40.885009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:40.885466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:40.886137 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:40.886610 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:40.887026 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:41.024974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:41.032585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff2478f4-1d76-48ba-a00a-84af353b7bde tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1676 microversion: 2.1 time: 0.159657 Sep 01 07:51:41.033167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1491/2965] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:40 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:42.053483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:42.054093 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:42.060386 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:42.060864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:42.061332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:42.062010 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:42.062456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:42.062873 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:42.186627 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:42.194284 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ebbf8e8-6d42-47a0-923c-65d273b2d852 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1676 microversion: 2.1 time: 0.144569 Sep 01 07:51:42.194850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1475/2966] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:42 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:43.215433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:43.216120 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:43.222963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:43.223429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:43.223850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:43.224515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:43.224954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:43.225387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:43.355333 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:43.362809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-afb010e3-f834-4b4d-a817-a2a82bbb0071 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1676 microversion: 2.1 time: 0.151201 Sep 01 07:51:43.363368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1492/2967] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:43 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:44.383717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:44.384364 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:44.391254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:44.391740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:44.392181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:44.392866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:44.393351 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:44.393781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:44.524054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:44.532503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c18e9ddc-26cd-499e-b942-870a62345fdd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1676 microversion: 2.1 time: 0.152653 Sep 01 07:51:44.533062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1476/2968] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:44 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:45.552969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:45.553621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:45.559986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:45.560454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:45.560874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:45.561578 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:45.562016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:45.562433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:45.690407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:45.698864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-97923651-963a-4614-937f-7fa00a0eddf8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1653 microversion: 2.1 time: 0.149656 Sep 01 07:51:45.699558 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1493/2969] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:45 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:45.720025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31e16323-9bc2-4a7f-9e4a-b286cd977d69 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:51:45.726405 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e16323-9bc2-4a7f-9e4a-b286cd977d69 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:45.726887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e16323-9bc2-4a7f-9e4a-b286cd977d69 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:45.727324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31e16323-9bc2-4a7f-9e4a-b286cd977d69 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:45.749391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-31e16323-9bc2-4a7f-9e4a-b286cd977d69 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Going to try to start instance {{(pid=120638) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 07:51:45.790947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-31e16323-9bc2-4a7f-9e4a-b286cd977d69 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/action" status: 202 len: 0 microversion: 2.1 time: 0.075142 Sep 01 07:51:45.791546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1477/2970] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 07:51:45 2022] POST /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:51:45.800280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:45.800881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:45.806817 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:45.807340 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:45.807804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:45.808514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:45.809038 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:45.809476 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:46.237658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:46.245268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4e20efd-95e6-4eb2-8469-ae190e161f05 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1662 microversion: 2.1 time: 0.448991 Sep 01 07:51:46.245837 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1494/2971] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:45 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1662 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:47.267495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:47.268201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:47.274256 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:47.274990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:47.275446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:47.276121 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:47.276572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:47.276988 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:47.405853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:47.413556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-60ddf7f2-1570-4cc6-a4a5-c330ef548584 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1662 microversion: 2.1 time: 0.150741 Sep 01 07:51:47.414122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1478/2972] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:47 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:48.433784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:48.434382 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:48.441811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:48.442286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:48.442715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:48.443395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:48.443838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:48.444253 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:48.573568 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:48.581074 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ea4a8b5-f77f-4c5d-95dd-8861391bb3e9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1666 microversion: 2.1 time: 0.151115 Sep 01 07:51:48.581655 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1495/2973] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:48 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:49.827534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:49.828029 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:49.833898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:49.834697 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:49.835137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:49.835816 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:49.836259 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:49.836679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:49.861321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:51:49.934778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-388b0454-c79b-4b82-b689-a69a2cc01adc tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 204 len: 0 microversion: 2.1 time: 0.216074 Sep 01 07:51:49.935374 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1479/2974] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:51:49 2022] DELETE /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:51:49.943596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:49.944222 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:49.951631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:49.951933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:49.952354 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:49.953234 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:49.953672 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:49.954083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:50.083187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:50.090840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4d2b4393-d85a-4aae-b765-78f1e10042d2 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1576 microversion: 2.1 time: 0.151100 Sep 01 07:51:50.091394 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1496/2975] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:49 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:51.112623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:51.113347 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:51.119652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:51.120127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:51.120824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:51.121537 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:51.121985 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:51.122401 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:51.254546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:51.262539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-432c1e4a-8b0c-4392-af5c-ee9f4e14f5ea tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1576 microversion: 2.1 time: 0.154742 Sep 01 07:51:51.263091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1480/2976] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:51 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:52.284246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:52.284848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:52.293194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:52.296867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:52.297618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:52.298343 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:52.298804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:52.299377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:52.384876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:52.392547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25d4f2f9-cb7c-4aff-b119-65de514177c8 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1509 microversion: 2.1 time: 0.112109 Sep 01 07:51:52.393164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1497/2977] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:52 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1509 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:52.599485 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-e16047ba-d4b8-4fd0-9c6a-ff25b2cf0f14 req-9e3c15f7-9bd9-488d-972d-17903e038225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5cefdc-d023-4097-bd9a-7b91c212112c", "name": "network-vif-deleted", "tag": "8365188e-523d-4b45-a823-b4c65370574d"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:51:52.611277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e16047ba-d4b8-4fd0-9c6a-ff25b2cf0f14 req-9e3c15f7-9bd9-488d-972d-17903e038225 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:52.611824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e16047ba-d4b8-4fd0-9c6a-ff25b2cf0f14 req-9e3c15f7-9bd9-488d-972d-17903e038225 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:52.612467 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-e16047ba-d4b8-4fd0-9c6a-ff25b2cf0f14 req-9e3c15f7-9bd9-488d-972d-17903e038225 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:52.626281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-e16047ba-d4b8-4fd0-9c6a-ff25b2cf0f14 req-9e3c15f7-9bd9-488d-972d-17903e038225 service nova] Creating event network-vif-deleted:8365188e-523d-4b45-a823-b4c65370574d for instance 9f5cefdc-d023-4097-bd9a-7b91c212112c on hv-cinder-73306 Sep 01 07:51:52.632097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-e16047ba-d4b8-4fd0-9c6a-ff25b2cf0f14 req-9e3c15f7-9bd9-488d-972d-17903e038225 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035433 Sep 01 07:51:52.632654 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1481/2978] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:51:53.414609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:53.415208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:53.431365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:53.431855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:53.432277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:53.433110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:53.433432 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:53.433833 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:53.469446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:53.469960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:53.471307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:53.471762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lazy-loading 'fault' on Instance uuid 9f5cefdc-d023-4097-bd9a-7b91c212112c {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:51:53.519264 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:53.531171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1173a5cc-3a54-430b-9c2e-c6547cca7011 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 200 len: 1230 microversion: 2.1 time: 0.120721 Sep 01 07:51:53.533645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1498/2979] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:53 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 1230 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:54.553031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:54.553908 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:54.561038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:54.561565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:54.562005 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:54.562698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:54.563153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:54.563582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:54.576639 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] HTTP exception thrown: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Request method failure captured: Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c HTTP/1.1 Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGNkr8lnpoR11FWKs_K1nyCW65L6OpvAM7mUrgQHyMga3yJfBNGlpFJd1YN8ShTtdxTHO9QcNmvLvJ4Op4j_H6p4E-t4A70xjSw-KthWBT-rLof0FgaDnYOwp_DNAIJTfh1E7L6ToxA7W8rMH9QYw5WaVl18rKiWM7PryOPGLULqbD8 Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:51:54.578181 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5069d6a3a34a08bb00105a91251cf2", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestVolumeBootPattern-512668393 Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 93b2cf587dc44209a186fc453ac5bdfc Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:51:54.579598 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '9f5cefdc-d023-4097-bd9a-7b91c212112c'} Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:51:54.580413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:51:54.581773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:51:54.582915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Returning 404 to user: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:51:54.582915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7f8859d2-35f8-4a80-b7dc-d6673e27e37b tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 404 len: 111 microversion: 2.1 time: 0.031426 Sep 01 07:51:54.582915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1482/2980] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:54 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:51:54.628102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-663063065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-159046410", "security_groups": [{"name": "tempest-secgroup-smoke-659639042"}], "block_device_mapping_v2": [{"uuid": "1d8b1fcf-ebd8-4ca6-8067-65c16445ee47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12e730ee-3f90-4c7d-91ff-0643ead39468"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:51:54.740993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] validate_networks() for [('12e730ee-3f90-4c7d-91ff-0643ead39468', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:51:55.108456 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:51:55.108872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:51:55.109364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:51:55.109807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:51:55.110208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:51:55.118581 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:55.119047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:55.119473 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:55.120175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:55.120614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:55.121053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:55.136921 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Getting quotas for project df5069d6a3a34a08bb00105a91251cf2. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:51:55.141273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Getting quotas for user 93b2cf587dc44209a186fc453ac5bdfc and project df5069d6a3a34a08bb00105a91251cf2. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:51:55.196747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:51:55.198857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1d8b1fcf-ebd8-4ca6-8067-65c16445ee47',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:51:55.324734 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e48bab38-7b14-453a-9eef-452eba242a3a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.700399 Sep 01 07:51:55.325590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1499/2981] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:51:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:51:55.337710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-6d99c2dd-74b2-4342-b28a-113d498525a5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:55.338323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-6d99c2dd-74b2-4342-b28a-113d498525a5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:55.392811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-6d99c2dd-74b2-4342-b28a-113d498525a5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:55.399945 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-6d99c2dd-74b2-4342-b28a-113d498525a5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1093 microversion: 2.1 time: 0.065752 Sep 01 07:51:55.400531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1483/2982] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:55 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:56.420270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:56.421454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:56.428289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:56.428773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:56.429238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:56.430813 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:56.431299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:56.432047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:56.516839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:56.525134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-915cf6fb-52f3-4b6f-939c-57790a971607 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1199 microversion: 2.1 time: 0.109172 Sep 01 07:51:56.525801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1500/2983] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:56 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:57.549390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:57.549999 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:57.559504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:57.559921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:57.560353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:57.561043 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:57.562026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:57.562446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:57.791826 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:57.799874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d5f0f908-b924-429f-980a-6eefd14e152a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.254199 Sep 01 07:51:57.800452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1484/2984] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:57 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:51:57.892651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-9ed0e2b1-ae94-4f5e-8beb-24cbcfaf5ea6 req-b1676440-bdd5-44e3-89f6-cf06569f8c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5145486-a32b-4b05-bee7-16b16479ea69", "tag": "67533239-6dc5-41d2-8ca9-e22a567dd861"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:51:57.903528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9ed0e2b1-ae94-4f5e-8beb-24cbcfaf5ea6 req-b1676440-bdd5-44e3-89f6-cf06569f8c51 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:57.904131 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9ed0e2b1-ae94-4f5e-8beb-24cbcfaf5ea6 req-b1676440-bdd5-44e3-89f6-cf06569f8c51 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:57.904651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-9ed0e2b1-ae94-4f5e-8beb-24cbcfaf5ea6 req-b1676440-bdd5-44e3-89f6-cf06569f8c51 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:57.916009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-9ed0e2b1-ae94-4f5e-8beb-24cbcfaf5ea6 req-b1676440-bdd5-44e3-89f6-cf06569f8c51 service nova] Creating event network-changed:67533239-6dc5-41d2-8ca9-e22a567dd861 for instance b5145486-a32b-4b05-bee7-16b16479ea69 on hv-cinder-73306 Sep 01 07:51:57.921645 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-9ed0e2b1-ae94-4f5e-8beb-24cbcfaf5ea6 req-b1676440-bdd5-44e3-89f6-cf06569f8c51 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032219 Sep 01 07:51:57.922304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1501/2985] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:51:58.821183 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:51:58.821803 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:51:58.828638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:58.829155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:58.829604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:58.830302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:51:58.830767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:51:58.831196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:51:59.051150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:51:59.058751 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-821990f3-4717-4216-ac59-194016e4d7ad tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.241492 Sep 01 07:51:59.059312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1485/2986] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:51:58 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:00.081463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:00.082181 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:00.088285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:00.088763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:00.089221 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:00.089903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:00.090350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:00.090765 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:00.222893 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:00.230386 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de52aa2c-b7bb-43b7-a2a9-2893da6d94ba tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.154220 Sep 01 07:52:00.230935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1502/2987] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:00 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:01.250553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:01.251158 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:01.257724 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:01.258184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:01.258619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:01.259298 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:01.259747 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:01.260168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:01.386534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:01.394179 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d129d8a6-15d5-4d96-8bec-a29494b78d4a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.147449 Sep 01 07:52:01.394740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1486/2988] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:01 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:02.415341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:02.415978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:02.422915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:02.423389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:02.423819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:02.424494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:02.424938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:02.425850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:02.556263 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:02.564455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-714e1825-7801-47d5-b863-f23bc515076a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.152990 Sep 01 07:52:02.565015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1503/2989] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:02 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:03.583739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:03.584344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:03.590886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:03.591370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:03.591837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:03.592519 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:03.592968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:03.593930 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:03.721852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:03.729378 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-17d9a684-8883-4521-a315-f0cf973e52c1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.149490 Sep 01 07:52:03.729968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1487/2990] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:03 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:04.750173 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:04.750800 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:04.756914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:04.757413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:04.757840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:04.758514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:04.758953 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:04.759364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:04.885459 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:04.893756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd7aa863-0353-459a-bcfa-8813aee998aa tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.147518 Sep 01 07:52:04.894323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1504/2991] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:04 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:52:05.915352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:05.915963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:05.918388 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:05.924355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:05.924835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:05.925313 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:05.926007 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:05.926465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:05.926887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:05.944719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:06.061419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:06.068979 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-5f2aa756-7cb2-40cc-9df4-b830f346bf0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.157499 Sep 01 07:52:06.069576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1488/2992] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:05 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:07.089256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:07.089859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:07.091891 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:07.092660 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:07.098872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:07.099445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:07.099857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:07.100550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:07.100990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:07.101506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:07.228838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:07.237790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe02a5ff-2d70-454d-b87e-951581a30b48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.152374 Sep 01 07:52:07.238418 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1505/2993] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:07 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:08.258186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:08.258791 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:08.264635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:08.265122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:08.266188 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:08.266884 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:08.267332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:08.267754 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:08.400553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:08.409234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c68ee08a-f900-4510-9986-fd054c775471 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.154947 Sep 01 07:52:08.409807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1489/2994] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:08 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:08.535815 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-452cb5ce-b972-4d45-ad96-e9844eadff5c req-840752c2-db2d-4dc8-9426-7132df32084b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5145486-a32b-4b05-bee7-16b16479ea69", "name": "network-vif-plugged", "status": "completed", "tag": "67533239-6dc5-41d2-8ca9-e22a567dd861"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:52:08.546500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-452cb5ce-b972-4d45-ad96-e9844eadff5c req-840752c2-db2d-4dc8-9426-7132df32084b service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:08.547631 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-452cb5ce-b972-4d45-ad96-e9844eadff5c req-840752c2-db2d-4dc8-9426-7132df32084b service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:08.548081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-452cb5ce-b972-4d45-ad96-e9844eadff5c req-840752c2-db2d-4dc8-9426-7132df32084b service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:08.559054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-452cb5ce-b972-4d45-ad96-e9844eadff5c req-840752c2-db2d-4dc8-9426-7132df32084b service nova] Creating event network-vif-plugged:67533239-6dc5-41d2-8ca9-e22a567dd861 for instance b5145486-a32b-4b05-bee7-16b16479ea69 on hv-cinder-73306 Sep 01 07:52:08.564644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-452cb5ce-b972-4d45-ad96-e9844eadff5c req-840752c2-db2d-4dc8-9426-7132df32084b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032936 Sep 01 07:52:08.565424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1506/2995] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:52:09.431817 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:09.432449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:09.434750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:09.440539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:09.441016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:09.441650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:09.442335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:09.442785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:09.443205 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:09.574327 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:09.582534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-28660a1a-5dca-4b95-9a4c-a754d1ff33b5 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.154556 Sep 01 07:52:09.583097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1490/2996] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:09 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:10.612338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:10.613041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:10.615046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:10.622911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:10.623390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:10.623825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:10.624506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:10.625015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:10.625991 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:10.628551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:10.763410 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:10.771054 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6145cbf4-8bbc-4768-bc44-b48df8374217 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1264 microversion: 2.1 time: 0.163873 Sep 01 07:52:10.771606 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1507/2997] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:10 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:11.791479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:11.792097 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:11.798567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:11.799055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:11.799491 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:11.800176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:11.800631 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:11.801053 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:11.928868 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:11.936502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-67cf07ed-3e90-42d2-89ab-3334db591428 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1450 microversion: 2.1 time: 0.148954 Sep 01 07:52:11.937065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1491/2998] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:11 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:11.956954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:11.957589 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:11.964012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:11.964485 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:11.964957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:11.965666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:11.966107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:11.966520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:12.097825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:12.105534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aa79f203-1cbe-4be8-bff9-a444517b211f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1450 microversion: 2.1 time: 0.152918 Sep 01 07:52:12.106097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1508/2999] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:11 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:13.920526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-3d54afe9-49ee-47c4-8144-96e3e1efa7e8 req-f2d330f6-781c-4bb1-911b-a6f7a9e42c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5145486-a32b-4b05-bee7-16b16479ea69", "tag": "67533239-6dc5-41d2-8ca9-e22a567dd861"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:52:13.930124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3d54afe9-49ee-47c4-8144-96e3e1efa7e8 req-f2d330f6-781c-4bb1-911b-a6f7a9e42c75 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:13.930607 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3d54afe9-49ee-47c4-8144-96e3e1efa7e8 req-f2d330f6-781c-4bb1-911b-a6f7a9e42c75 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:13.931041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3d54afe9-49ee-47c4-8144-96e3e1efa7e8 req-f2d330f6-781c-4bb1-911b-a6f7a9e42c75 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:13.942606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-3d54afe9-49ee-47c4-8144-96e3e1efa7e8 req-f2d330f6-781c-4bb1-911b-a6f7a9e42c75 service nova] Creating event network-changed:67533239-6dc5-41d2-8ca9-e22a567dd861 for instance b5145486-a32b-4b05-bee7-16b16479ea69 on hv-cinder-73306 Sep 01 07:52:13.947636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-3d54afe9-49ee-47c4-8144-96e3e1efa7e8 req-f2d330f6-781c-4bb1-911b-a6f7a9e42c75 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030723 Sep 01 07:52:13.948235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1492/3000] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:52:21.492747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:21.494994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:21.501538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:21.502013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:21.502443 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:21.503125 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:21.503570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:21.503988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:21.533171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07993403-ba83-498e-a52b-ec035b66ec22 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044260 Sep 01 07:52:21.533726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1509/3001] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:52:21 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:52:21.595539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:21.596117 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:21.602112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:21.602592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:21.603025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:21.603699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:21.604148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:21.604566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:21.629382 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:52:21.701787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be3ba412-d410-45e0-bc54-ec811e791618 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 204 len: 0 microversion: 2.1 time: 0.111061 Sep 01 07:52:21.702289 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1493/3002] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:52:21 2022] DELETE /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:52:21.710357 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:21.710973 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:21.716774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:21.717280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:21.717709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:21.718384 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:21.718827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:21.719243 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:21.851064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:21.858648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84ad35bc-ab90-426a-abca-0239471d538d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1672 microversion: 2.1 time: 0.152064 Sep 01 07:52:21.859215 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1510/3003] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:21 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:22.880942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:22.881675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:22.888038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:22.888523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:22.888961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:22.889675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:22.890136 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:22.890559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:23.016538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:23.024387 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8a5c8b12-8d73-4af3-8682-fe10af1e07e5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1672 microversion: 2.1 time: 0.147580 Sep 01 07:52:23.025000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1494/3004] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:22 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:24.046986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:24.046986 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:24.054647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:24.055129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:24.055560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:24.056303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:24.056725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:24.057236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:24.271336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:24.280081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee928d8a-210d-418e-8bcc-b38142c427d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1672 microversion: 2.1 time: 0.237434 Sep 01 07:52:24.280762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1511/3005] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:24 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1672 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:52:24.951493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-1f49eb58-1140-4647-846f-195023cb4de3 req-e28f7987-e899-4a8d-be93-4d73cc93ad1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de81900-cf33-47d8-be99-069ba32f748b", "name": "network-vif-deleted", "tag": "cdaa9c7a-b03d-4c22-a6f3-072d8f312946"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:52:24.960867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:52:24.960867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:52:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 01 07:52:24.962044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:52:24.962323 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:52:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 01 07:52:24.966329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1f49eb58-1140-4647-846f-195023cb4de3 req-e28f7987-e899-4a8d-be93-4d73cc93ad1d service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:24.966806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1f49eb58-1140-4647-846f-195023cb4de3 req-e28f7987-e899-4a8d-be93-4d73cc93ad1d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:24.967239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-1f49eb58-1140-4647-846f-195023cb4de3 req-e28f7987-e899-4a8d-be93-4d73cc93ad1d service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:24.980400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-1f49eb58-1140-4647-846f-195023cb4de3 req-e28f7987-e899-4a8d-be93-4d73cc93ad1d service nova] Creating event network-vif-deleted:cdaa9c7a-b03d-4c22-a6f3-072d8f312946 for instance 3de81900-cf33-47d8-be99-069ba32f748b on hv-cinder-73306 Sep 01 07:52:24.986142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-1f49eb58-1140-4647-846f-195023cb4de3 req-e28f7987-e899-4a8d-be93-4d73cc93ad1d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038368 Sep 01 07:52:24.987266 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1495/3006] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:52:25.301011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:25.301656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:25.307997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:25.308479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:25.308913 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:25.309621 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:25.310066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:25.310488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:25.342547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:25.343022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:25.343444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:25.343879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lazy-loading 'fault' on Instance uuid 3de81900-cf33-47d8-be99-069ba32f748b {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:52:25.388318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:25.396060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bef60776-052c-4182-bd13-35b7e5f6b453 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 200 len: 1327 microversion: 2.1 time: 0.098836 Sep 01 07:52:25.396630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1512/3007] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:25 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:26.418769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:26.419470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:26.425687 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:26.426174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:26.426614 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:26.427310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:26.427796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:26.428226 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:26.441233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] HTTP exception thrown: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Request method failure captured: Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b HTTP/1.1 Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGQDkMA1MMDs-A-8-Apjrmbk635mksv12RSOax9QHW_YDzK1m6THkWdw0aqZH6mUVC8J4P3VbAdtm731VqO9l8UD9V-i41lsVxpVeFb0Yn1L61AFR5vRa59dq2HTbXYeEtYzKDxCNyQI7UaiYiW7z8CrW39Q-LdnjHZCeZlJHC_OTw8 Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:52:26.442858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6a0433dc28924fc891b5e114c521bb57", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 4496d5005b0040e8b70020740e9e3401 Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:52:26.444187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '3de81900-cf33-47d8-be99-069ba32f748b'} Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:52:26.444885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:52:26.445954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:52:26.446943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Returning 404 to user: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:52:26.448059 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-890c7493-3d25-4250-a86b-33ed11bdce11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 404 len: 111 microversion: 2.1 time: 0.030180 Sep 01 07:52:26.448796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1496/3008] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:26 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:52:26.457829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-823075de-bb52-47f5-94c3-ad2f5ee3ea34 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '.version_select at 0x7f78d2a31700>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:26.480332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-823075de-bb52-47f5-94c3-ad2f5ee3ea34 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309775656" status: 202 len: 0 microversion: 2.1 time: 0.026866 Sep 01 07:52:26.480903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1513/3009] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Sep 1 07:52:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309775656 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:52:27.085312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bf8d3c30-e35d-4cee-a006-0f331bf03838 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'create', calling method: .version_select at 0x7f78cf2013a0>, body: {"keypair": {"name": "tempest-keypair-947780498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc8wZ4X9odXXC2kEweLUhVd6KV2TjRdL3bYZUss97H20ME43MtX+wr8tqbPY5Evrx0Xuo9jSCvqr00Nfya2/cYGMsjr9sJwRR9BTGXFsKl0nPRjQ61FgXh5o7XIrNl/og=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:52:27.101159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-bf8d3c30-e35d-4cee-a006-0f331bf03838 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Getting quotas for project 6a0433dc28924fc891b5e114c521bb57. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:52:27.104888 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-bf8d3c30-e35d-4cee-a006-0f331bf03838 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Getting quotas for user 4496d5005b0040e8b70020740e9e3401 and project 6a0433dc28924fc891b5e114c521bb57. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:52:27.129524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bf8d3c30-e35d-4cee-a006-0f331bf03838 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049787 Sep 01 07:52:27.130118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1497/3010] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:52:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:52:28.622429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-676160664", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8d5567c-fd2e-4a88-9e08-ba44f06c1010"}], "security_groups": [{"name": "tempest-securitygroup--860396639"}], "key_name": "tempest-keypair-947780498", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:52:28.727268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] validate_networks() for [('f8d5567c-fd2e-4a88-9e08-ba44f06c1010', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:52:29.087316 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:52:29.087733 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:52:29.088203 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:52:29.088604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:52:29.089005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:52:29.098437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:29.099225 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:29.099994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:29.101139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:29.101599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:29.102030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:29.119892 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Getting quotas for project 6a0433dc28924fc891b5e114c521bb57. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:52:29.123822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Getting quotas for user 4496d5005b0040e8b70020740e9e3401 and project 6a0433dc28924fc891b5e114c521bb57. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:52:29.135102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:52:29.137397 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:52:29.183431 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a804baf9-b5b0-4589-8e5c-d15307a21c4b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565765 Sep 01 07:52:29.184068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1514/3011] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:52:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:52:29.196488 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9c90e1cc-ee9a-44e0-b612-6f2dec20daec tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:29.197146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9c90e1cc-ee9a-44e0-b612-6f2dec20daec tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:29.249755 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9c90e1cc-ee9a-44e0-b612-6f2dec20daec tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:29.256905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9c90e1cc-ee9a-44e0-b612-6f2dec20daec tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1236 microversion: 2.1 time: 0.064748 Sep 01 07:52:29.257496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1498/3012] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:29 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:52:30.277573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca6128e3-07b0-418c-aaa8-035b8550ec13 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:30.278182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca6128e3-07b0-418c-aaa8-035b8550ec13 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:30.329532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca6128e3-07b0-418c-aaa8-035b8550ec13 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:30.338667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca6128e3-07b0-418c-aaa8-035b8550ec13 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1236 microversion: 2.1 time: 0.065644 Sep 01 07:52:30.339211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1515/3013] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:30 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:31.358739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fb14265d-5499-47dc-af8d-0d740f0f1235 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:31.359349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fb14265d-5499-47dc-af8d-0d740f0f1235 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:31.420597 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fb14265d-5499-47dc-af8d-0d740f0f1235 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:31.428277 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fb14265d-5499-47dc-af8d-0d740f0f1235 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1236 microversion: 2.1 time: 0.073364 Sep 01 07:52:31.428833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1499/3014] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:31 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:32.447709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-77ea8eaa-d756-4c39-a6ea-da3eb8f4c989 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:32.448307 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-77ea8eaa-d756-4c39-a6ea-da3eb8f4c989 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:32.506901 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-77ea8eaa-d756-4c39-a6ea-da3eb8f4c989 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:32.513617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-77ea8eaa-d756-4c39-a6ea-da3eb8f4c989 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1236 microversion: 2.1 time: 0.069726 Sep 01 07:52:32.514241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1516/3015] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:32 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:33.535111 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:33.535718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:33.542739 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:33.543215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:33.543647 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:33.544325 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:33.544774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:33.545217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:33.604822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:33.613051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0858204f-216b-4be0-98a9-44c5598d2290 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1240 microversion: 2.1 time: 0.082318 Sep 01 07:52:33.613636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1500/3016] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:33 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:34.632588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:34.633224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:34.639510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:34.639998 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:34.640439 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:34.641149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:34.641829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:34.642517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:34.730701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:34.738760 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-635f1847-2aae-4d08-9dd2-b9fd1bc1a9f6 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1294 microversion: 2.1 time: 0.109967 Sep 01 07:52:34.739328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1517/3017] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:34 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:35.759716 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:35.760328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:35.767554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:35.768051 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:35.768493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:35.769350 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:35.769719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:35.770144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:35.850574 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b3a7c206-88b6-4ef9-a349-30e0b1b473cf req-1a1a68bf-3989-44eb-86ad-89d2b7d86118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca", "tag": "51480581-9223-4f61-8498-b65a639a75c1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:52:35.861365 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b3a7c206-88b6-4ef9-a349-30e0b1b473cf req-1a1a68bf-3989-44eb-86ad-89d2b7d86118 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:35.861835 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b3a7c206-88b6-4ef9-a349-30e0b1b473cf req-1a1a68bf-3989-44eb-86ad-89d2b7d86118 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:35.862685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b3a7c206-88b6-4ef9-a349-30e0b1b473cf req-1a1a68bf-3989-44eb-86ad-89d2b7d86118 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:35.874047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b3a7c206-88b6-4ef9-a349-30e0b1b473cf req-1a1a68bf-3989-44eb-86ad-89d2b7d86118 service nova] Creating event network-changed:51480581-9223-4f61-8498-b65a639a75c1 for instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca on hv-cinder-73306 Sep 01 07:52:35.879547 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b3a7c206-88b6-4ef9-a349-30e0b1b473cf req-1a1a68bf-3989-44eb-86ad-89d2b7d86118 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032687 Sep 01 07:52:35.880132 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1518/3018] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:52:35.988218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:35.990596 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:35.997623 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-024410a8-9ab6-4f34-a591-7f9b8e6c2075 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1361 microversion: 2.1 time: 0.241751 Sep 01 07:52:35.998194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1501/3019] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:35 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:37.020012 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:37.020622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:37.026978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:37.027454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:37.027887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:37.028562 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:37.029009 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:37.029462 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:37.159706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:37.167266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1b0dcfdb-4c2f-46e3-b796-5aa181fcd947 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1361 microversion: 2.1 time: 0.152480 Sep 01 07:52:37.167840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1519/3020] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:37 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:38.188217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:38.188831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:38.195551 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:38.196031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:38.196466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:38.197170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:38.197629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:38.198050 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:38.325520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:38.333556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a01f0f8d-c75e-4700-b533-a53aa2ffb3d2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1361 microversion: 2.1 time: 0.149678 Sep 01 07:52:38.334122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1502/3021] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:38 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:39.355051 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:39.355654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:39.358068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:39.363896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:39.364372 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:39.364799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:39.365579 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:39.366021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:39.366435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:39.561006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:39.568512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ec248fa-7053-4ef5-bc19-c9c93df4d007 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1361 microversion: 2.1 time: 0.217357 Sep 01 07:52:39.569077 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1520/3022] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:39 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:40.589146 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:40.589758 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:40.592086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:40.597869 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:40.598349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:40.598862 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:40.599545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:40.599991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:40.600410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:40.681331 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-04bdf2e6-c319-4c6c-bc51-d17da8f4489f req-d18ddfb3-5117-4b94-ae14-c67a1cca790e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca", "name": "network-vif-plugged", "status": "completed", "tag": "51480581-9223-4f61-8498-b65a639a75c1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:52:40.686849 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:40.692827 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-04bdf2e6-c319-4c6c-bc51-d17da8f4489f req-d18ddfb3-5117-4b94-ae14-c67a1cca790e service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:40.693327 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-04bdf2e6-c319-4c6c-bc51-d17da8f4489f req-d18ddfb3-5117-4b94-ae14-c67a1cca790e service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:40.693917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-04bdf2e6-c319-4c6c-bc51-d17da8f4489f req-d18ddfb3-5117-4b94-ae14-c67a1cca790e service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:40.708601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=60 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:40.711897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-04bdf2e6-c319-4c6c-bc51-d17da8f4489f req-d18ddfb3-5117-4b94-ae14-c67a1cca790e service nova] Creating event network-vif-plugged:51480581-9223-4f61-8498-b65a639a75c1 for instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca on hv-cinder-73306 Sep 01 07:52:40.717500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-04bdf2e6-c319-4c6c-bc51-d17da8f4489f req-d18ddfb3-5117-4b94-ae14-c67a1cca790e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039917 Sep 01 07:52:40.719642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1521/3023] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:52:40.736996 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:40.744743 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-eee67800-b817-4f77-88e5-8e5bc4c3fbc5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1361 microversion: 2.1 time: 0.159398 Sep 01 07:52:40.745434 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1503/3024] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:40 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:41.767627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:41.768310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:41.775762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:41.776292 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:41.776718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:41.777412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:41.777850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:41.778277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:41.905503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:41.913488 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f32db720-6485-4811-b9be-698dc2676d2a tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1361 microversion: 2.1 time: 0.151356 Sep 01 07:52:41.914043 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1522/3025] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:41 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:42.933568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:42.934174 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:42.936001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=8 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:42.941641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:42.942124 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:42.942558 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:42.943239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:42.943685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:42.944104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:43.069320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:52:43.076859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-fd472693-6fe4-48a8-b3eb-5a60a47cbe87 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1548 microversion: 2.1 time: 0.147135 Sep 01 07:52:43.077456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1504/3026] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:52:42 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:52:43.097985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:52:43.098455 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:52:43.100424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:52:43.105943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:43.106413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:43.106839 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:43.107506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:43.107947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:43.108361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:43.184326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8ce8ce2e-84bc-464e-959c-4489627d3524 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090621 Sep 01 07:52:43.184868 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1523/3027] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 07:52:43 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:52:44.341861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-86409e86-5526-477f-a8ba-ab21a2fb9daa req-cd86cddd-09bb-46dd-9e4c-04ef68db3f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca", "tag": "51480581-9223-4f61-8498-b65a639a75c1"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:52:44.352274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-86409e86-5526-477f-a8ba-ab21a2fb9daa req-cd86cddd-09bb-46dd-9e4c-04ef68db3f47 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:52:44.352752 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-86409e86-5526-477f-a8ba-ab21a2fb9daa req-cd86cddd-09bb-46dd-9e4c-04ef68db3f47 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:52:44.353209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-86409e86-5526-477f-a8ba-ab21a2fb9daa req-cd86cddd-09bb-46dd-9e4c-04ef68db3f47 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:52:44.363769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-86409e86-5526-477f-a8ba-ab21a2fb9daa req-cd86cddd-09bb-46dd-9e4c-04ef68db3f47 service nova] Creating event network-changed:51480581-9223-4f61-8498-b65a639a75c1 for instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca on hv-cinder-73306 Sep 01 07:52:44.368748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-86409e86-5526-477f-a8ba-ab21a2fb9daa req-cd86cddd-09bb-46dd-9e4c-04ef68db3f47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030503 Sep 01 07:52:44.369760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1505/3028] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:20.581880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=5 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:53:20.582674 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=11 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:53:20.586513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:20.586989 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:20.593514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:20.593985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:20.594407 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:20.595676 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:20.596117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:20.596533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:20.620784 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9717b91-0642-488c-8fc1-30f4848a6ba4 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/ips" status: 200 len: 147 microversion: 2.1 time: 0.040358 Sep 01 07:53:20.621359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1524/3029] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:53:20 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:21.937194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=5 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:53:21.937938 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=21 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:53:21.942912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11e4d3f9-1c84-4b36-88e4-ee9d4b62279e"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:53:21.945329 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:21.952517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:21.952998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:21.953466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:21.954685 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:21.955137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:21.955556 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:22.215012 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f98c9973-8e30-4ef7-9753-21926693ed72 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279457 Sep 01 07:53:22.215615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1506/3030] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:53:21 2022] POST /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:29.726917 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:29.729016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:29.735401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:29.736481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:29.736927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:29.737595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:29.738035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:29.738446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:29.767274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4a5fd80-e114-4a39-8f9a-b755316e884e tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Sep 01 07:53:29.767590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1525/3031] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:53:29 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:29.779192 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:29.779768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:29.786376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:29.786860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:29.787293 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:29.787976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:29.788430 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:29.788882 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:29.817296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3d6e057a-811c-4f83-8062-e6aff91f9edc tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/11e4d3f9-1c84-4b36-88e4-ee9d4b62279e" status: 200 len: 194 microversion: 2.1 time: 0.043048 Sep 01 07:53:29.817807 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1507/3032] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Sep 1 07:53:29 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/11e4d3f9-1c84-4b36-88e4-ee9d4b62279e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:31.136498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "540f551f-0751-4b10-8983-bd2af38228d9"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:53:31.138843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:31.145326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:31.145804 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:31.146239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:31.146919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:31.147361 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:31.147786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:31.420034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad098165-220d-4f88-a6d9-27200730e33d tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "POST /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287318 Sep 01 07:53:31.420689 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1526/3033] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:53:31 2022] POST /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:38.947645 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:38.949935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:38.956261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:38.956742 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:38.957214 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:38.957902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:38.958353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:38.958779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:38.988808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-45e68611-f2bb-4017-8b02-66f427027eed tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045045 Sep 01 07:53:38.989390 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1508/3034] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:53:38 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:39.162948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:39.163514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:39.170042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:39.170518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:39.170944 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:39.171614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:39.172053 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:39.172469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:39.199961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dae46e18-0f99-4ceb-a4c7-124adfebfd11 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/11e4d3f9-1c84-4b36-88e4-ee9d4b62279e" status: 200 len: 194 microversion: 2.1 time: 0.042084 Sep 01 07:53:39.200514 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1527/3035] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Sep 1 07:53:39 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/11e4d3f9-1c84-4b36-88e4-ee9d4b62279e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:39.211084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:39.211568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:39.217773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:39.218252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:39.218679 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:39.219353 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:39.219802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:39.220220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:39.301448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lazy-loading 'services' on Instance uuid e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:53:39.371735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c0ad2028-8777-47d4-abba-79d60153cea8 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/11e4d3f9-1c84-4b36-88e4-ee9d4b62279e" status: 202 len: 0 microversion: 2.1 time: 0.164307 Sep 01 07:53:39.372324 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1509/3036] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:53:39 2022] DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/11e4d3f9-1c84-4b36-88e4-ee9d4b62279e => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:53:41.546663 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:41.547177 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:41.553668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:41.554142 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:41.554573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:41.555247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:41.555695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:41.556115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:41.585412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bacffdc0-c7a0-4412-aeaa-047d884b6625 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/540f551f-0751-4b10-8983-bd2af38228d9" status: 200 len: 194 microversion: 2.1 time: 0.042603 Sep 01 07:53:41.585985 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1528/3037] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Sep 1 07:53:41 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/540f551f-0751-4b10-8983-bd2af38228d9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:41.597228 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:41.597841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:41.603963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:41.604444 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:41.604880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:41.605588 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:41.606045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:41.606469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:41.835771 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lazy-loading 'services' on Instance uuid e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:53:41.905450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a0c9fd0e-135a-4746-897e-a8a55eb9f5a7 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/540f551f-0751-4b10-8983-bd2af38228d9" status: 202 len: 0 microversion: 2.1 time: 0.312684 Sep 01 07:53:41.906038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1510/3038] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:53:41 2022] DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments/540f551f-0751-4b10-8983-bd2af38228d9 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:53:43.069519 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:43.071688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:43.077873 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:43.078345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:43.078774 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:43.079498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:43.079947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:43.080364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:43.109080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-229bb307-cc84-49e3-bb44-f4ec3df1e60f tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043611 Sep 01 07:53:43.109640 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1529/3039] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:53:43 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:53:43.220572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:43.222901 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:43.228956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:43.229487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:43.229929 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:43.230615 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:43.231077 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:43.231502 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:43.261976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b541a3d0-ee66-4218-8540-53f3de0e9fd9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045624 Sep 01 07:53:43.262922 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1511/3040] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:53:43 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:53:43.327772 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:43.328199 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:43.334753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:43.335231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:43.335661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:43.336336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:43.336780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:43.337229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:43.361533 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:53:43.442826 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-389f3666-180c-483c-8823-beaaf3ae57d9 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 204 len: 0 microversion: 2.1 time: 0.118631 Sep 01 07:53:43.443575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1530/3041] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:53:43 2022] DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:53:43.452466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:43.453210 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:43.459796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:43.460286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:43.460723 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:43.461436 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:43.461887 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:43.462310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:43.594895 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:53:43.602606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d835203d-d306-43bc-aff8-b11881e6eb6b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1673 microversion: 2.1 time: 0.154666 Sep 01 07:53:43.603162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1512/3042] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:53:43 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:53:44.624392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:44.625087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:44.631336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:44.631806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:44.632233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:44.632899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:44.633371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:44.633783 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:44.759167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:53:44.766984 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c4ae645-2044-4369-9efd-4a8b8cb31250 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1673 microversion: 2.1 time: 0.146785 Sep 01 07:53:44.767648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1531/3043] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:53:44 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:53:45.788923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:45.789579 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:45.796110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:45.796648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:45.797087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:45.797906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:45.798355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:45.798779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:45.996409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:53:46.004241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-cbaa9a64-59a1-473c-928c-5fd27835d126 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1673 microversion: 2.1 time: 0.219661 Sep 01 07:53:46.004804 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1513/3044] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:53:45 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:53:46.695442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-8bb146ab-5eda-4083-b372-f465acb8ffd8 req-87aabe4d-63fc-4f62-ab47-807cf1155809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca", "name": "network-vif-deleted", "tag": "51480581-9223-4f61-8498-b65a639a75c1"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:53:46.706229 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8bb146ab-5eda-4083-b372-f465acb8ffd8 req-87aabe4d-63fc-4f62-ab47-807cf1155809 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:46.707570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8bb146ab-5eda-4083-b372-f465acb8ffd8 req-87aabe4d-63fc-4f62-ab47-807cf1155809 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:46.707992 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8bb146ab-5eda-4083-b372-f465acb8ffd8 req-87aabe4d-63fc-4f62-ab47-807cf1155809 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:46.719220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-8bb146ab-5eda-4083-b372-f465acb8ffd8 req-87aabe4d-63fc-4f62-ab47-807cf1155809 service nova] Creating event network-vif-deleted:51480581-9223-4f61-8498-b65a639a75c1 for instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca on hv-cinder-73306 Sep 01 07:53:46.724242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-8bb146ab-5eda-4083-b372-f465acb8ffd8 req-87aabe4d-63fc-4f62-ab47-807cf1155809 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032995 Sep 01 07:53:46.724842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1532/3045] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:53:47.025069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:47.025828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:47.033062 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:47.033613 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:47.034057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:47.034760 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:47.035215 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:47.035799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:47.067106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:47.067584 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:47.068020 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:47.068460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lazy-loading 'fault' on Instance uuid e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:53:47.110815 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4496d5005b0040e8b70020740e9e3401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0433dc28924fc891b5e114c521bb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:53:47.118808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2c95decd-7e00-459e-b33f-099542d98233 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 200 len: 1326 microversion: 2.1 time: 0.097592 Sep 01 07:53:47.119360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1514/3046] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:53:47 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:53:48.140786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:48.141503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:48.148207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:48.148687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:48.149134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:48.149811 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:48.150252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:48.150669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:48.165139 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] HTTP exception thrown: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Request method failure captured: Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca HTTP/1.1 Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGQDkMA1MMDs-A-8-Apjrmbk635mksv12RSOax9QHW_YDzK1m6THkWdw0aqZH6mUVC8J4P3VbAdtm731VqO9l8UD9V-i41lsVxpVeFb0Yn1L61AFR5vRa59dq2HTbXYeEtYzKDxCNyQI7UaiYiW7z8CrW39Q-LdnjHZCeZlJHC_OTw8 Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:53:48.166732 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6a0433dc28924fc891b5e114c521bb57", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 4496d5005b0040e8b70020740e9e3401 Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:48.168136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca'} Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:53:48.168932 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:48.170111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:48.171066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Returning 404 to user: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:53:48.171066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d8ec33c-769a-4614-a0d6-5aa5804940c5 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 404 len: 111 microversion: 2.1 time: 0.031938 Sep 01 07:53:48.171066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1533/3047] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:53:48 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:53:48.177013 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1ed4026f-984f-49a7-b4fd-acce2bb9de3c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '.version_select at 0x7f78d2b51ee0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:48.195503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1ed4026f-984f-49a7-b4fd-acce2bb9de3c tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947780498" status: 202 len: 0 microversion: 2.1 time: 0.022380 Sep 01 07:53:48.196045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1515/3048] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Sep 1 07:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947780498 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:53:51.054023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:51.054518 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:51.056872 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:53:51.062068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:51.062539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:51.062964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:51.063627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:51.064066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:51.064479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:51.069799 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:53:51.080280 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] HTTP exception thrown: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Request method failure captured: Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca HTTP/1.1 Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGQDkMA1MMDs-A-8-Apjrmbk635mksv12RSOax9QHW_YDzK1m6THkWdw0aqZH6mUVC8J4P3VbAdtm731VqO9l8UD9V-i41lsVxpVeFb0Yn1L61AFR5vRa59dq2HTbXYeEtYzKDxCNyQI7UaiYiW7z8CrW39Q-LdnjHZCeZlJHC_OTw8 Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:53:51.082657 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6a0433dc28924fc891b5e114c521bb57", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 4496d5005b0040e8b70020740e9e3401 Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.084032 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca'} Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:53:51.084764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.085922 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.086966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Returning 404 to user: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:53:51.086966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d8f2e35-1ed6-4e1e-b893-34ccf68a80a2 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 404 len: 111 microversion: 2.1 time: 0.033804 Sep 01 07:53:51.086966 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1534/3049] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:53:51 2022] DELETE /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 07:53:51.093127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:51.093748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:51.100151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:51.100636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:51.101080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:51.101796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:51.102254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:51.102681 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:51.117066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] HTTP exception thrown: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Request method failure captured: Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca HTTP/1.1 Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGQDkMA1MMDs-A-8-Apjrmbk635mksv12RSOax9QHW_YDzK1m6THkWdw0aqZH6mUVC8J4P3VbAdtm731VqO9l8UD9V-i41lsVxpVeFb0Yn1L61AFR5vRa59dq2HTbXYeEtYzKDxCNyQI7UaiYiW7z8CrW39Q-LdnjHZCeZlJHC_OTw8 Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:53:51.118696 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6a0433dc28924fc891b5e114c521bb57", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 4496d5005b0040e8b70020740e9e3401 Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.120042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': 'e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca'} Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:53:51.120844 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. Sep 01 07:53:51.121990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:51.122936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Returning 404 to user: Instance e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:53:51.122936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e3694356-ac2d-44f5-927b-bfddbad81a0b tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca" status: 404 len: 111 microversion: 2.1 time: 0.031492 Sep 01 07:53:51.122936 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1516/3050] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:53:51 2022] GET /compute/v2.1/servers/e0ce24e1-3bf8-4e93-8fc3-48c8b93013ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:53:52.257627 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:52.258112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:52.265387 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:52.265859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:52.266288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:52.266972 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:52.267396 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:52.267805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:52.282291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] HTTP exception thrown: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Request method failure captured: Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b HTTP/1.1 Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGQDkMA1MMDs-A-8-Apjrmbk635mksv12RSOax9QHW_YDzK1m6THkWdw0aqZH6mUVC8J4P3VbAdtm731VqO9l8UD9V-i41lsVxpVeFb0Yn1L61AFR5vRa59dq2HTbXYeEtYzKDxCNyQI7UaiYiW7z8CrW39Q-LdnjHZCeZlJHC_OTw8 Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:53:52.283806 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6a0433dc28924fc891b5e114c521bb57", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 4496d5005b0040e8b70020740e9e3401 Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.285877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '3de81900-cf33-47d8-be99-069ba32f748b'} Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:53:52.286957 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.288306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.289706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Returning 404 to user: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:53:52.289706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a56b768-7869-4ff4-872e-e4a17fef91f1 tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 404 len: 111 microversion: 2.1 time: 0.032337 Sep 01 07:53:52.289706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1535/3051] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:53:52 2022] DELETE /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:53:52.294058 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:53:52.294677 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] [instance: 3de81900-cf33-47d8-be99-069ba32f748b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:53:52.297041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:53:52.302300 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:52.302787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:52.303227 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:52.303918 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:53:52.304538 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:53:52.304968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:53:52.310108 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:53:52.320779 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] HTTP exception thrown: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Request method failure captured: Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b HTTP/1.1 Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGQDkMA1MMDs-A-8-Apjrmbk635mksv12RSOax9QHW_YDzK1m6THkWdw0aqZH6mUVC8J4P3VbAdtm731VqO9l8UD9V-i41lsVxpVeFb0Yn1L61AFR5vRa59dq2HTbXYeEtYzKDxCNyQI7UaiYiW7z8CrW39Q-LdnjHZCeZlJHC_OTw8 Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:53:52.322466 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6a0433dc28924fc891b5e114c521bb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6a0433dc28924fc891b5e114c521bb57", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 6a0433dc28924fc891b5e114c521bb57 Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1476631187 Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 4496d5005b0040e8b70020740e9e3401 Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeTestJSON-1476631187-project Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.323846 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '3de81900-cf33-47d8-be99-069ba32f748b'} Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:53:52.324764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. Sep 01 07:53:52.326056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:53:52.327176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] Returning 404 to user: Instance 3de81900-cf33-47d8-be99-069ba32f748b could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:53:52.327176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-de356ec3-c621-45e4-abf6-76c31979dffd tempest-AttachVolumeTestJSON-1476631187 tempest-AttachVolumeTestJSON-1476631187-project] 10.222.0.46 "GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b" status: 404 len: 111 microversion: 2.1 time: 0.033609 Sep 01 07:53:52.327176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1517/3052] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:53:52 2022] GET /compute/v2.1/servers/3de81900-cf33-47d8-be99-069ba32f748b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:54:00.848900 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c1a7011-01a6-4d3d-91dd-d33dd7ca5e48 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: .version_select at 0x7f78cf1f2e50>, body: {"keypair": {"name": "tempest-keypair-1996448269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUJs9X/GP0OMYskwHhctQvcfkB9zlmHC59h5aEuR5UazI8uI34TMN78PKgdzwaiaBCrd5KnOTOuenk+CsCLBMX7JCdlMJMgRCE2O5shPZ6216QjEDsfDdmY6uQ9aAEf4w=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:00.864785 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0c1a7011-01a6-4d3d-91dd-d33dd7ca5e48 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for project 462cfcb8aad746289ff3c2a01219da07. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:54:00.868914 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-0c1a7011-01a6-4d3d-91dd-d33dd7ca5e48 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for user 135b44145a1d4712b0ea9b3f00d1bc30 and project 462cfcb8aad746289ff3c2a01219da07. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:54:00.891608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c1a7011-01a6-4d3d-91dd-d33dd7ca5e48 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.212016 Sep 01 07:54:00.892195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1536/3053] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:54:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:02.160690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1250552403", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9d7a663-68d9-4284-b194-c8aec96e9400"}], "security_groups": [{"name": "tempest-securitygroup--1648402236"}], "key_name": "tempest-keypair-1996448269", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:02.270822 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] validate_networks() for [('b9d7a663-68d9-4284-b194-c8aec96e9400', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:54:02.647976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:54:02.648400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:54:02.648879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:54:02.649332 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:54:02.649767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:54:02.658853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:02.659338 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:02.659776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:02.660496 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:02.660976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:02.661431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:02.678295 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for project 462cfcb8aad746289ff3c2a01219da07. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:54:02.682304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for user 135b44145a1d4712b0ea9b3f00d1bc30 and project 462cfcb8aad746289ff3c2a01219da07. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:54:02.693993 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:54:02.696528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:54:02.747905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a69fc10-e837-4920-b84e-71e8c0b89f85 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.591504 Sep 01 07:54:02.749472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1518/3054] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:54:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:54:02.760362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:02.766058 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19c03b36-b677-44a5-a077-25a89470eb80 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:02.766980 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19c03b36-b677-44a5-a077-25a89470eb80 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:02.833629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19c03b36-b677-44a5-a077-25a89470eb80 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:02.842395 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19c03b36-b677-44a5-a077-25a89470eb80 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1242 microversion: 2.1 time: 0.085323 Sep 01 07:54:02.843013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1537/3055] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:02 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:03.866748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:03.868060 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:03.875048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:03.875633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:03.876142 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:03.876939 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:03.877483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:03.878153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:04.008169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:04.019151 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-50c7e6d6-9c48-42fe-865a-9e5958c3bf71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1294 microversion: 2.1 time: 0.155873 Sep 01 07:54:04.029852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1519/3056] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:03 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1294 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:04.179508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-185741139", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-159046410", "security_groups": [{"name": "tempest-secgroup-smoke-659639042"}], "block_device_mapping_v2": [{"uuid": "aa7c46de-06fc-42ea-81df-4abef7c709c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12e730ee-3f90-4c7d-91ff-0643ead39468"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:04.496076 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] validate_networks() for [('12e730ee-3f90-4c7d-91ff-0643ead39468', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:54:05.042858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:05.043594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:05.050476 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:05.050994 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:05.052037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:05.052727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:05.053204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:05.053629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:05.168473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:05.176094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8f11b15f-372c-4014-8c64-dd64a62ecd82 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1300 microversion: 2.1 time: 0.137840 Sep 01 07:54:05.189408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1520/3057] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:05 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:54:05.417400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:54:05.417862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:54:05.418293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:54:05.418708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:54:05.419106 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:54:05.433725 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:05.434477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:05.434935 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:05.435658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:05.436219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:05.436656 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:05.454830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Getting quotas for project df5069d6a3a34a08bb00105a91251cf2. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:54:05.459722 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Getting quotas for user 93b2cf587dc44209a186fc453ac5bdfc and project df5069d6a3a34a08bb00105a91251cf2. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:54:05.521911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:54:05.524241 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa7c46de-06fc-42ea-81df-4abef7c709c1',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:54:05.677695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ef071f13-fe80-45c0-b587-02aa36536ced tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.502025 Sep 01 07:54:05.684469 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1538/3058] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:54:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:54:05.689528 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-904d378e-f24a-4f70-a81f-0ce3c09dc13d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:05.690542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-904d378e-f24a-4f70-a81f-0ce3c09dc13d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:05.782225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-904d378e-f24a-4f70-a81f-0ce3c09dc13d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:05.790220 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-904d378e-f24a-4f70-a81f-0ce3c09dc13d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1093 microversion: 2.1 time: 0.104620 Sep 01 07:54:05.790801 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1521/3059] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:05 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1093 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:54:06.136538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-d45bbdeb-52dd-4e36-8c51-2b0df4857135 req-9cb03772-0e89-40f7-b49f-75fcd8bf22ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e78c7ca-ab86-4f88-a871-7c1f7d8b421b", "tag": "409aea21-9f4f-4b5c-99b7-2f38dac0cbaa"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:06.147786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d45bbdeb-52dd-4e36-8c51-2b0df4857135 req-9cb03772-0e89-40f7-b49f-75fcd8bf22ad service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:06.148261 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d45bbdeb-52dd-4e36-8c51-2b0df4857135 req-9cb03772-0e89-40f7-b49f-75fcd8bf22ad service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:06.148860 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d45bbdeb-52dd-4e36-8c51-2b0df4857135 req-9cb03772-0e89-40f7-b49f-75fcd8bf22ad service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:06.162167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-d45bbdeb-52dd-4e36-8c51-2b0df4857135 req-9cb03772-0e89-40f7-b49f-75fcd8bf22ad service nova] Creating event network-changed:409aea21-9f4f-4b5c-99b7-2f38dac0cbaa for instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b on hv-cinder-73306 Sep 01 07:54:06.167104 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-d45bbdeb-52dd-4e36-8c51-2b0df4857135 req-9cb03772-0e89-40f7-b49f-75fcd8bf22ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034313 Sep 01 07:54:06.167875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1539/3060] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:54:06.206830 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:06.207589 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:06.216802 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:06.217953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:06.218449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:06.219153 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:06.219629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:06.220057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:06.430169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:06.437926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-7a733497-9118-45b9-b445-a7cfb4105920 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1368 microversion: 2.1 time: 0.244291 Sep 01 07:54:06.438482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1522/3061] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:06 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:06.812468 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:06.813235 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:06.819845 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:06.820315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:06.820740 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:06.821451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:06.821886 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:06.822297 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:06.886412 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:06.893862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18d4a36c-bc93-4aab-803d-cff003d5ed48 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1191 microversion: 2.1 time: 0.086262 Sep 01 07:54:06.894415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1540/3062] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:06 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:07.458031 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:07.458643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:07.465023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:07.465534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:07.465967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:07.466644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:07.467091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:07.467508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:07.593682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:07.601783 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dce34505-af90-4092-867e-404707942769 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1368 microversion: 2.1 time: 0.147629 Sep 01 07:54:07.602345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1523/3063] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:07 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:07.915224 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:07.915737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:07.922041 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:07.922513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:07.922942 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:07.923608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:07.924052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:07.924460 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:08.005939 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:08.018904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-877907be-3107-4b43-8e12-332bd4fd4b55 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1199 microversion: 2.1 time: 0.108072 Sep 01 07:54:08.034557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1541/3064] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:07 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1199 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:08.622795 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:08.623407 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:08.630814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:08.631302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:08.631740 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:08.632446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:08.632898 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:08.633762 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:08.829880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:08.845217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d338e9d6-07d1-419a-9c34-66f9d4358523 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1368 microversion: 2.1 time: 0.226241 Sep 01 07:54:08.845789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1524/3065] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:08 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:09.043491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:09.044771 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:09.053962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:09.054969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:09.055400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:09.056093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:09.056633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:09.057057 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:09.213238 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:09.221755 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b425e32-cee8-49d3-a159-33f25aa1cc9f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.183799 Sep 01 07:54:09.224223 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1542/3066] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:09 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:09.638806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-c068fb85-f54a-47ef-b909-3886e404e374 req-41d441cb-5141-49c5-a117-7640fd9c1773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c47c81-f2e2-4432-821b-c10548231374", "tag": "304891c7-070b-4e60-ae79-07f877a03058"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:09.652100 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c068fb85-f54a-47ef-b909-3886e404e374 req-41d441cb-5141-49c5-a117-7640fd9c1773 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:09.652694 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c068fb85-f54a-47ef-b909-3886e404e374 req-41d441cb-5141-49c5-a117-7640fd9c1773 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:09.653734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-c068fb85-f54a-47ef-b909-3886e404e374 req-41d441cb-5141-49c5-a117-7640fd9c1773 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:09.669855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-c068fb85-f54a-47ef-b909-3886e404e374 req-41d441cb-5141-49c5-a117-7640fd9c1773 service nova] Creating event network-changed:304891c7-070b-4e60-ae79-07f877a03058 for instance f6c47c81-f2e2-4432-821b-c10548231374 on hv-cinder-73306 Sep 01 07:54:09.676025 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-c068fb85-f54a-47ef-b909-3886e404e374 req-41d441cb-5141-49c5-a117-7640fd9c1773 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101169 Sep 01 07:54:09.677161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1525/3067] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:09.868475 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:09.869085 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:09.874853 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:09.875389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:09.875820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:09.876497 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:09.876952 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:09.877373 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:10.004529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:10.012169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18214413-eada-4281-8728-641a070273ec tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1368 microversion: 2.1 time: 0.148204 Sep 01 07:54:10.012730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1543/3068] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:09 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:10.244245 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:10.244856 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:10.250967 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:10.251446 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:10.251879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:10.252553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:10.253002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:10.253470 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:10.385264 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:10.392765 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-784d1b99-575b-4927-a2bd-bb6ab202a225 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.152642 Sep 01 07:54:10.393345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1526/3069] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:10 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:11.033011 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:11.033638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:11.040570 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:11.041031 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:11.041484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:11.042163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:11.042601 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:11.043013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:11.176926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:11.184710 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-57cace54-146e-4c80-9e4b-48f5d30caa61 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1368 microversion: 2.1 time: 0.155591 Sep 01 07:54:11.185300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1544/3070] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:11 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:11.287356 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-787fd575-e999-4d55-9a11-8cb906f1824c req-e9b1063c-5459-4dd6-acd3-cd934554716c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e78c7ca-ab86-4f88-a871-7c1f7d8b421b", "name": "network-vif-plugged", "status": "completed", "tag": "409aea21-9f4f-4b5c-99b7-2f38dac0cbaa"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:11.296812 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-787fd575-e999-4d55-9a11-8cb906f1824c req-e9b1063c-5459-4dd6-acd3-cd934554716c service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:11.297371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-787fd575-e999-4d55-9a11-8cb906f1824c req-e9b1063c-5459-4dd6-acd3-cd934554716c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:11.297805 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-787fd575-e999-4d55-9a11-8cb906f1824c req-e9b1063c-5459-4dd6-acd3-cd934554716c service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:11.308622 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-787fd575-e999-4d55-9a11-8cb906f1824c req-e9b1063c-5459-4dd6-acd3-cd934554716c service nova] Creating event network-vif-plugged:409aea21-9f4f-4b5c-99b7-2f38dac0cbaa for instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b on hv-cinder-73306 Sep 01 07:54:11.313312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-787fd575-e999-4d55-9a11-8cb906f1824c req-e9b1063c-5459-4dd6-acd3-cd934554716c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029584 Sep 01 07:54:11.313893 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1527/3071] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:11.414399 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:11.415039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:11.420990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:11.421506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:11.421937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:11.422616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:11.423061 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:11.423481 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:11.557182 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:11.565232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5656bfa4-453b-4417-8a88-248498d510a1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.155034 Sep 01 07:54:11.565909 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1545/3072] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:11 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:12.205516 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:12.206212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:12.212849 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:12.213358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:12.213794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:12.214508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:12.214957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:12.215376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:12.344493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:12.352039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-80fe07b3-a6e7-461e-aa49-b7fe3a0cb0bc tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1368 microversion: 2.1 time: 0.150747 Sep 01 07:54:12.352587 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1528/3073] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:12 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:12.585929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:12.586538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:12.593021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:12.593528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:12.593958 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:12.594638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:12.595083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:12.595498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:12.722937 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:12.730997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-177d538e-4f09-41d5-bdad-244caaeef6d3 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.148946 Sep 01 07:54:12.731557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1546/3074] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:12 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:13.373180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:13.373798 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:13.375767 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:13.381473 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:13.381959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:13.382403 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:13.383096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:13.383619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:13.384052 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:13.519128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:13.527902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-121199c7-0257-4c4b-a44c-e7f3f90266e9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1559 microversion: 2.1 time: 0.158660 Sep 01 07:54:13.528463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1529/3075] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:13 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:13.547588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:13.548080 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:13.554380 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:13.554851 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:13.555276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:13.555946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:13.556388 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:13.556805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:13.633695 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60b7badc-53b4-4ab8-9d9d-8144e82400d3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089912 Sep 01 07:54:13.634299 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1547/3076] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 07:54:13 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:13.752309 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:13.752968 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:13.759119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:13.759828 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:13.760270 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:13.760976 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:13.761459 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:13.761889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:14.047514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:14.055258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-017d8ecb-6b08-4af3-a14c-c0f2a8b2183c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.307407 Sep 01 07:54:14.055825 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1530/3077] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:13 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:14.684637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1dbff360-35b5-4be3-a7e0-baf28cd66cd7 req-63265bfd-b48e-49c6-b328-65be05447043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e78c7ca-ab86-4f88-a871-7c1f7d8b421b", "tag": "409aea21-9f4f-4b5c-99b7-2f38dac0cbaa"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:14.694705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1dbff360-35b5-4be3-a7e0-baf28cd66cd7 req-63265bfd-b48e-49c6-b328-65be05447043 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:14.695172 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1dbff360-35b5-4be3-a7e0-baf28cd66cd7 req-63265bfd-b48e-49c6-b328-65be05447043 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:14.695593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1dbff360-35b5-4be3-a7e0-baf28cd66cd7 req-63265bfd-b48e-49c6-b328-65be05447043 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:14.707126 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1dbff360-35b5-4be3-a7e0-baf28cd66cd7 req-63265bfd-b48e-49c6-b328-65be05447043 service nova] Creating event network-changed:409aea21-9f4f-4b5c-99b7-2f38dac0cbaa for instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b on hv-cinder-73306 Sep 01 07:54:14.712963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1dbff360-35b5-4be3-a7e0-baf28cd66cd7 req-63265bfd-b48e-49c6-b328-65be05447043 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087432 Sep 01 07:54:14.713834 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1548/3078] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:15.075235 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:15.075851 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:15.082559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:15.083057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:15.083682 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:15.084392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:15.084855 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:15.085328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:15.221162 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:15.230465 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c89569db-39ba-495b-a1d3-7c00f6008578 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.159057 Sep 01 07:54:15.231275 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1531/3079] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:15 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:16.252242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:16.252927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:16.255569 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:16.256288 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=12 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:16.262457 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:16.262927 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:16.263353 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:16.264021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:16.264527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:16.264884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:16.396274 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:16.404111 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be1e336a-7c39-45ba-8fd8-78ca469cd68d tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.156085 Sep 01 07:54:16.404670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1549/3080] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:16 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:17.423797 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:17.424414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:17.426287 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=8 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:17.432047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:17.432535 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:17.432977 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:17.433719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:17.434176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:17.434604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:17.566618 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:17.574728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac2a7312-ff0a-4aee-aeaf-1dbc35395e45 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.154834 Sep 01 07:54:17.575281 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1532/3081] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:17 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:18.595447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:18.596081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:18.602560 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:18.603039 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:18.603472 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:18.604149 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:18.604591 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:18.605010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:18.735072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:18.743272 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7cf0b396-c2b6-42e9-9357-9ada34d65e5a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.151683 Sep 01 07:54:18.743840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1550/3082] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:18 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:19.763582 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:19.764296 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:19.772484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:19.773495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:19.774254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:19.775492 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:19.776080 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:19.776773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:19.906484 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:19.914161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-646330f2-22c7-43a1-9189-3ce6e419db50 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.154623 Sep 01 07:54:19.914728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1533/3083] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:19 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:20.935022 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:20.935559 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:20.941975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:20.942445 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:20.942876 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:20.943575 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:20.944019 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:20.944436 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:21.071267 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:21.078881 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-298bd80d-bac5-4014-814a-0b7249692a21 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.147703 Sep 01 07:54:21.079447 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1551/3084] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:20 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:21.263372 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-3817e456-88ec-4035-b937-b7b803867b07 req-86d80a5f-f20f-420f-a14b-bd4ef1bf7d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c47c81-f2e2-4432-821b-c10548231374", "name": "network-vif-plugged", "status": "completed", "tag": "304891c7-070b-4e60-ae79-07f877a03058"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:21.273789 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3817e456-88ec-4035-b937-b7b803867b07 req-86d80a5f-f20f-420f-a14b-bd4ef1bf7d14 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:21.274274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3817e456-88ec-4035-b937-b7b803867b07 req-86d80a5f-f20f-420f-a14b-bd4ef1bf7d14 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:21.274713 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-3817e456-88ec-4035-b937-b7b803867b07 req-86d80a5f-f20f-420f-a14b-bd4ef1bf7d14 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:21.285780 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-3817e456-88ec-4035-b937-b7b803867b07 req-86d80a5f-f20f-420f-a14b-bd4ef1bf7d14 service nova] Creating event network-vif-plugged:304891c7-070b-4e60-ae79-07f877a03058 for instance f6c47c81-f2e2-4432-821b-c10548231374 on hv-cinder-73306 Sep 01 07:54:21.290643 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-3817e456-88ec-4035-b937-b7b803867b07 req-86d80a5f-f20f-420f-a14b-bd4ef1bf7d14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084117 Sep 01 07:54:21.291219 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1534/3085] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:22.100239 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:22.100840 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:22.103167 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:22.108350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:22.108822 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:22.109290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:22.109967 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:22.110408 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:22.110821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:22.241178 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:22.248711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2b0b496-f6f3-444e-b57b-b1686a30c05f tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1264 microversion: 2.1 time: 0.152883 Sep 01 07:54:22.249290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1552/3086] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:22 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:23.270055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:23.270745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:23.272664 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:23.278352 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:23.278834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:23.279268 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:23.279950 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:23.280400 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:23.280824 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:23.408565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:23.416750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bbaee838-00b4-4cb3-8c6d-830a402216d6 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1451 microversion: 2.1 time: 0.151468 Sep 01 07:54:23.417341 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1535/3087] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:23 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:23.436877 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:23.437534 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:23.444236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:23.444709 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:23.445164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:23.445874 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:23.446323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:23.446741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:23.579268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:54:23.587389 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee766d73-dd81-46ad-9d27-8f8cd512e5f7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1451 microversion: 2.1 time: 0.154293 Sep 01 07:54:23.588117 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1553/3088] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:54:23 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:54:25.401177 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-544e2f51-0ed7-4d05-a530-c6097a20e330 req-cb19c187-a0b0-48a5-b9f2-e6db35d5de6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c47c81-f2e2-4432-821b-c10548231374", "tag": "304891c7-070b-4e60-ae79-07f877a03058"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:25.410944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-544e2f51-0ed7-4d05-a530-c6097a20e330 req-cb19c187-a0b0-48a5-b9f2-e6db35d5de6e service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:25.411960 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-544e2f51-0ed7-4d05-a530-c6097a20e330 req-cb19c187-a0b0-48a5-b9f2-e6db35d5de6e service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:25.412391 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-544e2f51-0ed7-4d05-a530-c6097a20e330 req-cb19c187-a0b0-48a5-b9f2-e6db35d5de6e service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:25.423152 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-544e2f51-0ed7-4d05-a530-c6097a20e330 req-cb19c187-a0b0-48a5-b9f2-e6db35d5de6e service nova] Creating event network-changed:304891c7-070b-4e60-ae79-07f877a03058 for instance f6c47c81-f2e2-4432-821b-c10548231374 on hv-cinder-73306 Sep 01 07:54:25.428081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-544e2f51-0ed7-4d05-a530-c6097a20e330 req-cb19c187-a0b0-48a5-b9f2-e6db35d5de6e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030640 Sep 01 07:54:25.428858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1536/3089] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:50.644323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:54:50.644867 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:50.646887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:50.647517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=82 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:50.653062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:50.653550 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:50.653976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:50.654644 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:50.655090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:50.655504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:50.678402 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-abd669f7-4d63-4ce5-9e8b-347065346eda tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/ips" status: 200 len: 151 microversion: 2.1 time: 0.038266 Sep 01 07:54:50.678956 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1554/3090] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:54:50 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:52.030433 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:52.031186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=89 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:54:52.035548 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b6c0902-5cb6-4640-9d47-0364dc8e05bd"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:52.039122 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:54:52.045975 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:52.046457 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:52.046928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:52.047612 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:54:52.048066 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:54:52.048494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:54:52.309913 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f5555a02-5b46-4a5d-afdd-21c5ca22df8d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280808 Sep 01 07:54:52.310637 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1537/3091] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:54:52 2022] POST /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:54:59.830200 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18b5b2a8-8c84-4492-9576-dd1eceab4726 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: .version_select at 0x7f78cf0a13a0>, body: {"keypair": {"name": "tempest-keypair-815708673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBPna85OaFJ7gGHzSiYZBq7U4utjtNY2y9i+KFOEUDZLFxS82K+CA1CRF+9xhLY1Q6KK6Lr+6uViKBo2/BfxlKHoDq9T3u4plHhMxGevGRJCcRWnAgrcOcn15Wv0dU/Ug=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:54:59.846098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-18b5b2a8-8c84-4492-9576-dd1eceab4726 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for project 462cfcb8aad746289ff3c2a01219da07. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:54:59.850438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-18b5b2a8-8c84-4492-9576-dd1eceab4726 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for user 135b44145a1d4712b0ea9b3f00d1bc30 and project 462cfcb8aad746289ff3c2a01219da07. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:54:59.871595 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18b5b2a8-8c84-4492-9576-dd1eceab4726 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045073 Sep 01 07:54:59.872107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1555/3092] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:54:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:55:01.097718 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1721211836", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9d7a663-68d9-4284-b194-c8aec96e9400"}], "security_groups": [{"name": "tempest-securitygroup--423478766"}], "key_name": "tempest-keypair-815708673", "user_data": "}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:55:01.197283 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.network.neutron [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] validate_networks() for [('b9d7a663-68d9-4284-b194-c8aec96e9400', None, None, None, None, None)] {{(pid=120638) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:55:01.611885 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Flavor limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:55:01.612317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Image limits 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:55:01.612792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Flavor pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:55:01.613229 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Image pref 0:0:0 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:55:01.613710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.virt.hardware [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:55:01.622690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:01.623204 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:01.623648 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:01.624517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:01.624983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:01.625441 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:01.643039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for project 462cfcb8aad746289ff3c2a01219da07. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:55:01.647626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for user 135b44145a1d4712b0ea9b3f00d1bc30 and project 462cfcb8aad746289ff3c2a01219da07. Resources: {'cores', 'instances', 'ram'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:55:01.658707 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Going to run 1 instances... {{(pid=120638) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:55:01.661101 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:55:01.717486 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b8542d16-df76-4564-850f-2534384037c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.624348 Sep 01 07:55:01.718149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1538/3093] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:55:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:55:01.725919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:55:01.730506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-41d0a014-ddbd-41cc-8e41-e4d2503271e7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:01.731115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-41d0a014-ddbd-41cc-8e41-e4d2503271e7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:01.787668 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-41d0a014-ddbd-41cc-8e41-e4d2503271e7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:01.794442 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-41d0a014-ddbd-41cc-8e41-e4d2503271e7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1241 microversion: 2.1 time: 0.069316 Sep 01 07:55:01.795064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1556/3094] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:01 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:02.815001 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:02.815625 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:02.822448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:02.822933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:02.823376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:02.824065 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:02.824520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:02.824948 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:02.892452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:02.900015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-9cbc713d-0d28-4e5e-9f37-c0fa1bbcade6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1293 microversion: 2.1 time: 0.089431 Sep 01 07:55:02.900576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1539/3095] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:02 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:03.921629 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:03.922282 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:03.929208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:03.929643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:03.930078 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:03.930769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:03.931217 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:03.931642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:04.071705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:04.079708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5c82859-d0b6-4311-aa34-60e67dc34c28 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1366 microversion: 2.1 time: 0.161849 Sep 01 07:55:04.080296 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1557/3096] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:03 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:04.614600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-cd7cda14-2eff-4e32-97af-2326c07111e3 req-99b418de-5922-49ea-9565-bfe5a16853c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de89439d-109f-49e7-a3e0-5a6b0cd48b23", "tag": "1084781b-d167-4716-9105-2376227f14d9"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:55:04.625731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cd7cda14-2eff-4e32-97af-2326c07111e3 req-99b418de-5922-49ea-9565-bfe5a16853c3 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:04.626216 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cd7cda14-2eff-4e32-97af-2326c07111e3 req-99b418de-5922-49ea-9565-bfe5a16853c3 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:04.627033 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-cd7cda14-2eff-4e32-97af-2326c07111e3 req-99b418de-5922-49ea-9565-bfe5a16853c3 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:04.638458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-cd7cda14-2eff-4e32-97af-2326c07111e3 req-99b418de-5922-49ea-9565-bfe5a16853c3 service nova] Creating event network-changed:1084781b-d167-4716-9105-2376227f14d9 for instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 on hv-cinder-73306 Sep 01 07:55:04.643326 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-cd7cda14-2eff-4e32-97af-2326c07111e3 req-99b418de-5922-49ea-9565-bfe5a16853c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033662 Sep 01 07:55:04.643943 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1540/3097] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:55:05.101081 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:05.101716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:05.107696 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:05.108165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:05.108593 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:05.109291 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:05.109730 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:05.110145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:05.241231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:05.248708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a757dbf0-5cb4-4ee8-b81e-10ad45d7fa42 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1366 microversion: 2.1 time: 0.151500 Sep 01 07:55:05.249285 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1558/3098] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:05 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:06.270040 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:06.270843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:06.277964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:06.278447 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:06.278880 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:06.279570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:06.280023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:06.280483 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:06.410144 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:06.418106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4009b502-1d92-41bc-bed7-e4aabf2a214c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1366 microversion: 2.1 time: 0.152723 Sep 01 07:55:06.418680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1541/3099] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:06 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:07.439008 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:07.439670 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:07.446042 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:07.446517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:07.446947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:07.447624 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:07.448071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:07.448491 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:07.575433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:07.583018 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed48962d-9561-48ce-a798-de34e9b7d9db tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1366 microversion: 2.1 time: 0.147882 Sep 01 07:55:07.583576 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1559/3100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:07 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:08.602990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:08.603633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:08.609963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:08.610448 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:08.610886 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:08.611574 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:08.612030 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:08.612463 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:08.744892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:08.752721 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f00c46f3-7357-4c59-afe6-5e5fc3d66e94 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1366 microversion: 2.1 time: 0.153583 Sep 01 07:55:08.753320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1542/3101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:08 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:09.775071 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:09.776207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:09.782638 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:09.783123 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:09.783554 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:09.784277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:09.784726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:09.785169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:09.913424 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:09.921079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dcecc255-c744-45c2-ba8d-83367a664eeb tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1366 microversion: 2.1 time: 0.151223 Sep 01 07:55:09.921661 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1560/3102] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:09 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:10.942106 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:10.942722 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:10.949157 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:10.949638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:10.950073 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:10.950753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:10.951207 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:10.951628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:11.080858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:11.089074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3da4bc1f-4338-486d-bfe4-3f0da51cc66e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1366 microversion: 2.1 time: 0.150914 Sep 01 07:55:11.089663 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1543/3103] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:10 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:11.368711 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-8b7a0981-e2be-468b-8506-e7f6c6088957 req-796c1638-dfe4-47d9-ba69-1132510607d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de89439d-109f-49e7-a3e0-5a6b0cd48b23", "name": "network-vif-plugged", "status": "completed", "tag": "1084781b-d167-4716-9105-2376227f14d9"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:55:11.379006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8b7a0981-e2be-468b-8506-e7f6c6088957 req-796c1638-dfe4-47d9-ba69-1132510607d5 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:11.379482 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8b7a0981-e2be-468b-8506-e7f6c6088957 req-796c1638-dfe4-47d9-ba69-1132510607d5 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:11.379919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-8b7a0981-e2be-468b-8506-e7f6c6088957 req-796c1638-dfe4-47d9-ba69-1132510607d5 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:11.391258 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-8b7a0981-e2be-468b-8506-e7f6c6088957 req-796c1638-dfe4-47d9-ba69-1132510607d5 service nova] Creating event network-vif-plugged:1084781b-d167-4716-9105-2376227f14d9 for instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 on hv-cinder-73306 Sep 01 07:55:11.396270 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-8b7a0981-e2be-468b-8506-e7f6c6088957 req-796c1638-dfe4-47d9-ba69-1132510607d5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031217 Sep 01 07:55:11.396852 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1561/3104] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:55:12.109770 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:12.110379 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:12.112299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:55:12.112935 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:55:12.119414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:12.119889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:12.120320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:12.120995 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:12.121497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:12.121919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:12.246011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:12.253472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2f7e807c-f25c-4abd-b5ae-3e773ca7dea9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1366 microversion: 2.1 time: 0.147482 Sep 01 07:55:12.254032 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1544/3105] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:12 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:13.270490 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:55:13.275176 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:13.275862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:13.282352 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:13.282825 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:13.283246 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:13.283916 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:13.284356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:13.284769 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:13.410598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:13.418588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0399498c-bdac-4f88-9dde-276db6ba2ddf tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1556 microversion: 2.1 time: 0.149092 Sep 01 07:55:13.419141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1562/3106] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:13 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:13.438931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:13.439418 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:13.445794 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:13.446279 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:13.446719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:13.447417 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:13.447874 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:13.448301 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:13.530456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4ad44fa7-9ffe-4c29-b284-35e7ef57f2c5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095268 Sep 01 07:55:13.531061 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1545/3107] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 07:55:13 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:55:14.443903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-814e0bf1-c24a-44bb-8b23-3bd98541f79e req-757b4419-5ac8-46b6-b949-fbf3e19413b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de89439d-109f-49e7-a3e0-5a6b0cd48b23", "tag": "1084781b-d167-4716-9105-2376227f14d9"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:55:14.453829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-814e0bf1-c24a-44bb-8b23-3bd98541f79e req-757b4419-5ac8-46b6-b949-fbf3e19413b1 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:14.454300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-814e0bf1-c24a-44bb-8b23-3bd98541f79e req-757b4419-5ac8-46b6-b949-fbf3e19413b1 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:14.454726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-814e0bf1-c24a-44bb-8b23-3bd98541f79e req-757b4419-5ac8-46b6-b949-fbf3e19413b1 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:14.466036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-814e0bf1-c24a-44bb-8b23-3bd98541f79e req-757b4419-5ac8-46b6-b949-fbf3e19413b1 service nova] Creating event network-changed:1084781b-d167-4716-9105-2376227f14d9 for instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 on hv-cinder-73306 Sep 01 07:55:14.471349 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-814e0bf1-c24a-44bb-8b23-3bd98541f79e req-757b4419-5ac8-46b6-b949-fbf3e19413b1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031128 Sep 01 07:55:14.471941 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1563/3108] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:55:50.572831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:55:50.573619 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:55:50.578527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:50.579048 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:50.587172 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:50.587646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:50.588653 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:50.589360 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:50.589811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:50.590233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:50.614339 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-941d3bd5-3018-47ea-93c7-baf985da062f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23/ips" status: 200 len: 150 microversion: 2.1 time: 0.043433 Sep 01 07:55:50.614900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1546/3109] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:55:50 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:55:50.624113 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:55:50.624847 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=34 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:55:50.629648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b6c0902-5cb6-4640-9d47-0364dc8e05bd"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:55:50.631995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:50.640236 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:50.640705 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:50.641138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:50.641821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:50.642262 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:50.642675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:50.721639 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Invalid volume: volume 4b6c0902-5cb6-4640-9d47-0364dc8e05bd is already attached to instances: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23/os-volume_attachments HTTP/1.1 Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 74 Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:55:50.723360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {"volumeAttachment": {"volumeId": "4b6c0902-5cb6-4640-9d47-0364dc8e05bd"}} Sep 01 07:55:50.725089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Invalid volume: volume 4b6c0902-5cb6-4640-9d47-0364dc8e05bd is already attached to instances: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'server_id': 'de89439d-109f-49e7-a3e0-5a6b0cd48b23', 'body': {'volumeAttachment': {'volumeId': '4b6c0902-5cb6-4640-9d47-0364dc8e05bd'}}} Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4b6c0902-5cb6-4640-9d47-0364dc8e05bd is already attached to instances: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:50.726313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4b6c0902-5cb6-4640-9d47-0364dc8e05bd is already attached to instances: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:55:50.727628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:55:50.729277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:55:50.729277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:55:50.729277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:55:50.729277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4b6c0902-5cb6-4640-9d47-0364dc8e05bd is already attached to instances: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b Sep 01 07:55:50.729277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:50.729277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 400 to user: Invalid volume: volume 4b6c0902-5cb6-4640-9d47-0364dc8e05bd is already attached to instances: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:55:50.729277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-809cf138-02fa-4ae9-a05b-ef43e3e2e8f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102235 Sep 01 07:55:50.729277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1564/3110] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:55:50 2022] POST /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:55:50.733236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:50.733736 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:50.739585 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:50.740067 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:50.740505 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:50.741212 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:50.741670 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:50.742098 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:50.769213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:55:50.844358 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a082ec9d-ff2b-47cb-819b-776a46e44e1a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 204 len: 0 microversion: 2.1 time: 0.114510 Sep 01 07:55:50.844923 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1547/3111] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:55:50 2022] DELETE /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:55:50.854492 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:50.855531 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:50.862023 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:50.862495 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:50.862929 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:50.863599 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:50.864040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:50.864451 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:50.992949 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:51.000919 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bc79bf5b-502e-40c2-883b-38a82640207f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1681 microversion: 2.1 time: 0.151569 Sep 01 07:55:51.001500 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1565/3112] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:50 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:52.024112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:52.024864 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:52.032038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:52.032514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:52.032949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:52.033662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:52.034109 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:52.034550 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:52.245413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:52.253016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1fa22dc7-eeb1-4498-95cd-cb4ceb0d99b1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1681 microversion: 2.1 time: 0.233123 Sep 01 07:55:52.253609 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1548/3113] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:52 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:53.274401 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:53.275016 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:53.282154 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:53.282636 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:53.283072 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:53.283768 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:53.284211 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:53.284633 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:53.350938 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:53.361820 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c494ab0-e881-41e0-8492-3b9ac151324b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 200 len: 1614 microversion: 2.1 time: 0.091128 Sep 01 07:55:53.362801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1566/3114] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:53 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:53.386148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-b5a7631e-5b4a-4caf-a493-2708c14de648 req-af16080d-32cc-4afa-b77a-c6cc294545c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de89439d-109f-49e7-a3e0-5a6b0cd48b23", "name": "network-vif-deleted", "tag": "1084781b-d167-4716-9105-2376227f14d9"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:55:53.396911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b5a7631e-5b4a-4caf-a493-2708c14de648 req-af16080d-32cc-4afa-b77a-c6cc294545c0 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:53.397431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b5a7631e-5b4a-4caf-a493-2708c14de648 req-af16080d-32cc-4afa-b77a-c6cc294545c0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:53.397853 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-b5a7631e-5b4a-4caf-a493-2708c14de648 req-af16080d-32cc-4afa-b77a-c6cc294545c0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:53.417398 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-b5a7631e-5b4a-4caf-a493-2708c14de648 req-af16080d-32cc-4afa-b77a-c6cc294545c0 service nova] Creating event network-vif-deleted:1084781b-d167-4716-9105-2376227f14d9 for instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 on hv-cinder-73306 Sep 01 07:55:53.422942 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-b5a7631e-5b4a-4caf-a493-2708c14de648 req-af16080d-32cc-4afa-b77a-c6cc294545c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040387 Sep 01 07:55:53.423547 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1549/3115] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:55:54.382865 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:54.383461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:54.389756 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:54.390226 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:54.390643 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:54.391309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:54.391750 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:54.392162 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:54.405975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 HTTP/1.1 Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:55:54.407494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:55:54.408667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'de89439d-109f-49e7-a3e0-5a6b0cd48b23'} Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:55:54.409413 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:55:54.410736 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:55:54.411920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:55:54.411920 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74f2ad0c-d6ae-482c-a950-fedf165dc55e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 404 len: 111 microversion: 2.1 time: 0.029997 Sep 01 07:55:54.412943 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1567/3116] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:54 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:55:54.419042 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-a8557937-bb22-450d-84dd-1f8428f475e5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '.version_select at 0x7f78d2a18940>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:54.437892 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-a8557937-bb22-450d-84dd-1f8428f475e5 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815708673" status: 202 len: 0 microversion: 2.1 time: 0.023587 Sep 01 07:55:54.438524 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1550/3117] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Sep 1 07:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815708673 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 07:55:55.356687 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:55.357277 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:55.363415 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:55.363887 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:55.364423 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:55.365095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:55.365609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:55.366021 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:55.445697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lazy-loading 'services' on Instance uuid 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:55:55.516864 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36432472-20f8-4bd2-8901-8330a7ec4a8e tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-volume_attachments/4b6c0902-5cb6-4640-9d47-0364dc8e05bd" status: 202 len: 0 microversion: 2.1 time: 0.163852 Sep 01 07:55:55.517544 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1568/3118] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:55:55 2022] DELETE /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-volume_attachments/4b6c0902-5cb6-4640-9d47-0364dc8e05bd => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:55:55.526285 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:55.528832 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:55.535545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:55.536038 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:55.536515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:55.537274 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:55.537733 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:55.538159 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:55.568786 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f2f4da7c-3340-429b-a1d7-627f73de0b69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046773 Sep 01 07:55:55.569310 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1551/3119] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:55:55 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:55:56.582183 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:56.584449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:56.591191 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:56.591659 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:56.592083 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:56.592746 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:56.593218 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:56.593630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:56.621230 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-63825abb-e4f2-4153-bb7f-77a0107653d9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043756 Sep 01 07:55:56.621776 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1569/3120] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:55:56 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:55:56.681774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:56.682257 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:56.690953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:56.691432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:56.691863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:56.692549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:56.692989 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:56.693440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:56.719592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Going to try to terminate instance {{(pid=120638) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:55:56.796427 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8d0b80d8-4956-4547-a4e5-76c7d082c844 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 204 len: 0 microversion: 2.1 time: 0.118173 Sep 01 07:55:56.797068 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1552/3121] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:55:56 2022] DELETE /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:55:56.805306 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:56.805915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:56.812377 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:56.812855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:56.813310 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:56.813990 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:56.814437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:56.814856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:56.943764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:56.951993 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66108db0-125e-43d2-842a-2e3a5d899bd4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1684 microversion: 2.1 time: 0.150795 Sep 01 07:55:56.952537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1570/3122] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:56 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:57.973286 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:57.974023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:57.980384 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:57.980866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:57.981337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:57.982015 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:57.982460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:57.982876 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:58.112450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:58.120090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-03bccf3f-a18a-4abe-bca5-d43d8f9bee4d tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1684 microversion: 2.1 time: 0.151141 Sep 01 07:55:58.120640 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1553/3123] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:57 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:59.140848 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:55:59.141487 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:55:59.147747 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:59.148252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:59.148682 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:59.149379 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:59.149824 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:59.150242 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:59.282122 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:55:59.291649 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd2f7cc7-05e2-4522-b462-49e35b5e8c79 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1684 microversion: 2.1 time: 0.154264 Sep 01 07:55:59.292667 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1571/3124] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:55:59 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:55:59.752666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-ffe92c83-968e-4d61-8b4f-73864941d4af req-7403323c-29ca-468d-a85d-0f49bc0a1810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e78c7ca-ab86-4f88-a871-7c1f7d8b421b", "name": "network-vif-deleted", "tag": "409aea21-9f4f-4b5c-99b7-2f38dac0cbaa"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:55:59.763656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ffe92c83-968e-4d61-8b4f-73864941d4af req-7403323c-29ca-468d-a85d-0f49bc0a1810 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:55:59.764241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ffe92c83-968e-4d61-8b4f-73864941d4af req-7403323c-29ca-468d-a85d-0f49bc0a1810 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:55:59.764699 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-ffe92c83-968e-4d61-8b4f-73864941d4af req-7403323c-29ca-468d-a85d-0f49bc0a1810 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:55:59.779959 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-ffe92c83-968e-4d61-8b4f-73864941d4af req-7403323c-29ca-468d-a85d-0f49bc0a1810 service nova] Creating event network-vif-deleted:409aea21-9f4f-4b5c-99b7-2f38dac0cbaa for instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b on hv-cinder-73306 Sep 01 07:55:59.784774 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-ffe92c83-968e-4d61-8b4f-73864941d4af req-7403323c-29ca-468d-a85d-0f49bc0a1810 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036490 Sep 01 07:55:59.785472 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1554/3125] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:00.315069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:00.316305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:00.322880 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:00.323364 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:00.323794 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:00.324467 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:00.324904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:00.325341 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:00.357632 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:00.358107 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:00.358535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:00.359145 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lazy-loading 'fault' on Instance uuid 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:56:00.408185 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:00.423532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-244fee13-aa99-4686-8adc-e7d5f0609f15 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 200 len: 1332 microversion: 2.1 time: 0.112131 Sep 01 07:56:00.424114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1572/3126] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:00 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:01.446572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:01.447278 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:01.454041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:01.454529 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:01.454966 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:01.455650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:01.456104 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:01.456531 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:01.469710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b HTTP/1.1 Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:56:01.471336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:56:01.472714 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '6e78c7ca-ab86-4f88-a871-7c1f7d8b421b'} Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:56:01.473650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:56:01.475018 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:01.476260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:56:01.476260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ca3bbde6-803c-4b69-9a8f-9585c7fad148 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 404 len: 111 microversion: 2.1 time: 0.030971 Sep 01 07:56:01.476260 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1555/3127] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:01 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:56:01.481478 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2a9472f-95aa-450c-b24d-5aac3ca884e4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '.version_select at 0x7f78d2b77dc0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:01.499898 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2a9472f-95aa-450c-b24d-5aac3ca884e4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996448269" status: 202 len: 0 microversion: 2.1 time: 0.022266 Sep 01 07:56:01.500444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1573/3128] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Sep 1 07:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996448269 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:56:02.115094 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba6243dd-6d27-4354-bfce-9db8894b9586 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: .version_select at 0x7f78d2b645e0>, body: {"keypair": {"name": "tempest-keypair-1209860697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEE56+JUU6y/Mhipm459NXuHs6n0nj6oiopnkAGbdy+EZmCb/V1e7TcPs+ipX+MZiT/ypy8O3gWWpDo+WYtkZawBhqQJyIoNwFvxQg83ObaZ3PBxfGf7IFYvmk3+JEx9NA=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:02.130090 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-ba6243dd-6d27-4354-bfce-9db8894b9586 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for project 462cfcb8aad746289ff3c2a01219da07. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:56:02.133910 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-ba6243dd-6d27-4354-bfce-9db8894b9586 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for user 135b44145a1d4712b0ea9b3f00d1bc30 and project 462cfcb8aad746289ff3c2a01219da07. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:56:02.156456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba6243dd-6d27-4354-bfce-9db8894b9586 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045243 Sep 01 07:56:02.157047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1556/3129] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:56:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:03.012862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:03.013498 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:03.017731 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-4df30778-4479-408d-8606-2fc437e004c2 req-09ac6610-ca06-4277-994d-19c8459589ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c47c81-f2e2-4432-821b-c10548231374", "tag": "304891c7-070b-4e60-ae79-07f877a03058"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:03.032546 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:03.035508 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4df30778-4479-408d-8606-2fc437e004c2 req-09ac6610-ca06-4277-994d-19c8459589ab service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:03.035992 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4df30778-4479-408d-8606-2fc437e004c2 req-09ac6610-ca06-4277-994d-19c8459589ab service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:03.036419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-4df30778-4479-408d-8606-2fc437e004c2 req-09ac6610-ca06-4277-994d-19c8459589ab service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:03.041420 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:03.042146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:03.042903 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:03.043347 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:03.043897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:03.055421 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-4df30778-4479-408d-8606-2fc437e004c2 req-09ac6610-ca06-4277-994d-19c8459589ab service nova] Creating event network-changed:304891c7-070b-4e60-ae79-07f877a03058 for instance f6c47c81-f2e2-4432-821b-c10548231374 on hv-cinder-73306 Sep 01 07:56:03.066642 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-4df30778-4479-408d-8606-2fc437e004c2 req-09ac6610-ca06-4277-994d-19c8459589ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057695 Sep 01 07:56:03.073317 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1557/3130] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:03.079276 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:56:03.169036 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b491b095-6587-4343-b000-aaa0d2930a4c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 204 len: 0 microversion: 2.1 time: 0.164227 Sep 01 07:56:03.169950 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1574/3131] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:56:03 2022] DELETE /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:56:03.178730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:03.179523 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:03.186412 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:03.187197 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:03.187860 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:03.188792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:03.189581 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:03.190237 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:03.336730 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:03.344956 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0b223abb-f275-4061-aa44-d4d32e119a1e tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1576 microversion: 2.1 time: 0.170326 Sep 01 07:56:03.345777 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1558/3132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:03 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:03.462859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2044861591", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9d7a663-68d9-4284-b194-c8aec96e9400"}], "security_groups": [{"name": "tempest-securitygroup--682217136"}], "key_name": "tempest-keypair-1209860697", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:03.567859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] validate_networks() for [('b9d7a663-68d9-4284-b194-c8aec96e9400', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:56:03.988743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:56:03.989197 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:56:03.989666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:56:03.990070 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:56:03.990480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:56:03.999866 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:04.000336 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:04.000764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:04.001509 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:04.001960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:04.002378 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:04.019974 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for project 462cfcb8aad746289ff3c2a01219da07. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:56:04.023856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for user 135b44145a1d4712b0ea9b3f00d1bc30 and project 462cfcb8aad746289ff3c2a01219da07. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:56:04.035002 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:56:04.037437 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:56:04.086539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08f3a8b3-e8f6-4fd7-be9e-990e1feea0ff tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.629485 Sep 01 07:56:04.087302 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1575/3133] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:56:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 07:56:04.098069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-651d4198-36a6-4c10-b6f8-dc566de0899b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:04.098838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-651d4198-36a6-4c10-b6f8-dc566de0899b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:04.158231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-651d4198-36a6-4c10-b6f8-dc566de0899b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:04.165085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-651d4198-36a6-4c10-b6f8-dc566de0899b tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1242 microversion: 2.1 time: 0.070840 Sep 01 07:56:04.165726 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1559/3134] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:04 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:56:04.365614 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:04.366219 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:04.372289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:04.372757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:04.373232 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:04.373904 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:04.374348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:04.374759 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:04.512309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:04.520037 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9953ba41-de69-4a70-861e-0a7269dbed0a tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1576 microversion: 2.1 time: 0.158301 Sep 01 07:56:04.520585 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1576/3135] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:04 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:56:05.186424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:05.187072 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:05.193980 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:05.194460 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:05.194889 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:05.195572 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:05.196019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:05.196456 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:05.268397 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:05.278773 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-92e6a679-c811-4f72-8c05-f15a4b0d0761 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1294 microversion: 2.1 time: 0.096951 Sep 01 07:56:05.281288 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1560/3136] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:05 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:05.541298 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:05.541906 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:05.549029 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:05.549538 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:05.549970 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:05.550654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:05.551097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:05.551512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:05.750334 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-98bcb2b2-a789-4fba-9912-a2aaa497128b req-5e4cfcca-6a56-4f70-8c06-37835cbfd447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c47c81-f2e2-4432-821b-c10548231374", "name": "network-vif-deleted", "tag": "304891c7-070b-4e60-ae79-07f877a03058"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:05.772520 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-98bcb2b2-a789-4fba-9912-a2aaa497128b req-5e4cfcca-6a56-4f70-8c06-37835cbfd447 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:05.773180 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-98bcb2b2-a789-4fba-9912-a2aaa497128b req-5e4cfcca-6a56-4f70-8c06-37835cbfd447 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:05.774788 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-98bcb2b2-a789-4fba-9912-a2aaa497128b req-5e4cfcca-6a56-4f70-8c06-37835cbfd447 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:05.785669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:05.792413 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-98bcb2b2-a789-4fba-9912-a2aaa497128b req-5e4cfcca-6a56-4f70-8c06-37835cbfd447 service nova] Creating event network-vif-deleted:304891c7-070b-4e60-ae79-07f877a03058 for instance f6c47c81-f2e2-4432-821b-c10548231374 on hv-cinder-73306 Sep 01 07:56:05.794788 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-959e0ba5-144b-488c-85bc-d73741e476ff tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1576 microversion: 2.1 time: 0.257357 Sep 01 07:56:05.795628 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1577/3137] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:05 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1576 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:05.812085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-98bcb2b2-a789-4fba-9912-a2aaa497128b req-5e4cfcca-6a56-4f70-8c06-37835cbfd447 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067226 Sep 01 07:56:05.812974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1561/3138] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:06.299988 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:06.300762 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:06.307524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:06.308622 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:06.309068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:06.309838 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:06.310286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:06.310714 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:06.376814 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:06.385044 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-061df1cf-9144-4fcd-8e7f-47157dbcc4a9 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1300 microversion: 2.1 time: 0.089273 Sep 01 07:56:06.385805 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1578/3139] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:06 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:06.818920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:06.819838 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:06.826626 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:06.827186 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:06.827861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:06.828621 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:06.829254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:06.829768 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:06.864600 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:06.865290 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:06.865861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:06.866545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lazy-loading 'fault' on Instance uuid f6c47c81-f2e2-4432-821b-c10548231374 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:56:06.915684 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:06.923135 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-250f77ae-45d5-4421-a077-6bba6a028c91 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 200 len: 1183 microversion: 2.1 time: 0.109049 Sep 01 07:56:06.923700 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1562/3140] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:06 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 1183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 07:56:07.296444 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1fc81830-0efe-4bf2-9bc2-3cd450964a8c req-271d28a9-e397-48aa-a5b3-fee36bfb3c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cfba9c6-35de-4d42-afa8-87b17035b49e", "tag": "eba5b51b-d72f-4192-a244-f09bf2890664"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:07.307975 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1fc81830-0efe-4bf2-9bc2-3cd450964a8c req-271d28a9-e397-48aa-a5b3-fee36bfb3c37 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:07.308911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1fc81830-0efe-4bf2-9bc2-3cd450964a8c req-271d28a9-e397-48aa-a5b3-fee36bfb3c37 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:07.309449 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1fc81830-0efe-4bf2-9bc2-3cd450964a8c req-271d28a9-e397-48aa-a5b3-fee36bfb3c37 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:07.323052 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1fc81830-0efe-4bf2-9bc2-3cd450964a8c req-271d28a9-e397-48aa-a5b3-fee36bfb3c37 service nova] Creating event network-changed:eba5b51b-d72f-4192-a244-f09bf2890664 for instance 6cfba9c6-35de-4d42-afa8-87b17035b49e on hv-cinder-73306 Sep 01 07:56:07.328323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1fc81830-0efe-4bf2-9bc2-3cd450964a8c req-271d28a9-e397-48aa-a5b3-fee36bfb3c37 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036103 Sep 01 07:56:07.328915 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1579/3141] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:56:07.407478 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:07.408112 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:07.414019 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:07.414500 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:07.414944 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:07.415628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:07.416127 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:07.416570 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:07.545037 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:07.553261 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-0e3ad316-b5b3-4669-a6f4-78ce38532439 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1367 microversion: 2.1 time: 0.149751 Sep 01 07:56:07.554056 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1563/3142] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:07 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:07.943552 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:07.944140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: f6c47c81-f2e2-4432-821b-c10548231374] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:07.951245 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:07.951716 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:07.952141 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:07.952807 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:07.953539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:07.953962 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:07.968062 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] HTTP exception thrown: Instance f6c47c81-f2e2-4432-821b-c10548231374 could not be found. Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Request method failure captured: Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 HTTP/1.1 Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGNkr8lnpoR11FWKs_K1nyCW65L6OpvAM7mUrgQHyMga3yJfBNGlpFJd1YN8ShTtdxTHO9QcNmvLvJ4Op4j_H6p4E-t4A70xjSw-KthWBT-rLof0FgaDnYOwp_DNAIJTfh1E7L6ToxA7W8rMH9QYw5WaVl18rKiWM7PryOPGLULqbD8 Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:56:07.969679 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5069d6a3a34a08bb00105a91251cf2", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 93b2cf587dc44209a186fc453ac5bdfc Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance f6c47c81-f2e2-4432-821b-c10548231374 could not be found. Sep 01 07:56:07.971134 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'f6c47c81-f2e2-4432-821b-c10548231374'} Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c47c81-f2e2-4432-821b-c10548231374 could not be found. Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:56:07.971976 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c47c81-f2e2-4432-821b-c10548231374 could not be found. Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c47c81-f2e2-4432-821b-c10548231374 could not be found. Sep 01 07:56:07.973356 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:07.974573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Returning 404 to user: Instance f6c47c81-f2e2-4432-821b-c10548231374 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:56:07.974573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ae6c78e-8359-42f6-9309-a0796309b4e7 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374" status: 404 len: 111 microversion: 2.1 time: 0.031873 Sep 01 07:56:07.974573 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1580/3143] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:07 2022] GET /compute/v2.1/servers/f6c47c81-f2e2-4432-821b-c10548231374 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:56:08.573546 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:08.574164 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:08.580542 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:08.581026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:08.581503 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:08.582190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:08.582644 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:08.583074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:08.708328 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:08.715928 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-701916e1-513b-470b-8cf9-667fb9512f8f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1367 microversion: 2.1 time: 0.146224 Sep 01 07:56:08.716497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1564/3144] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:08 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:09.736515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:09.737047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:09.743664 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:09.744129 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:09.744557 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:09.745252 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:09.746345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:09.746757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:09.765448 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:09.885138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:09.888118 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-133c476a-c9ab-4264-b497-98d3585d4dd1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1367 microversion: 2.1 time: 0.155566 Sep 01 07:56:09.888673 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1581/3145] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:09 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:10.908138 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:10.908748 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:10.915055 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:10.915540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:10.915974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:10.916652 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:10.917102 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:10.918044 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:10.937799 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:11.070293 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:11.070737 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:11.077362 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:11.077843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:11.078461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:11.079166 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:11.079616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:11.080067 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:11.097213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:11.105778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bad3e556-a85c-432b-8da4-97dc6d3dcc58 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1367 microversion: 2.1 time: 0.200875 Sep 01 07:56:11.106725 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1565/3146] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:10 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:11.109918 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:56:11.111879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-04b33093-a87c-4a56-8830-9b7db323c98e req-060b6621-04fa-4bc9-a1b4-68c57f2c4cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5145486-a32b-4b05-bee7-16b16479ea69", "tag": "67533239-6dc5-41d2-8ca9-e22a567dd861"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:11.121628 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-04b33093-a87c-4a56-8830-9b7db323c98e req-060b6621-04fa-4bc9-a1b4-68c57f2c4cb8 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:11.122156 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-04b33093-a87c-4a56-8830-9b7db323c98e req-060b6621-04fa-4bc9-a1b4-68c57f2c4cb8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:11.123129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-04b33093-a87c-4a56-8830-9b7db323c98e req-060b6621-04fa-4bc9-a1b4-68c57f2c4cb8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:11.134497 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-04b33093-a87c-4a56-8830-9b7db323c98e req-060b6621-04fa-4bc9-a1b4-68c57f2c4cb8 service nova] Creating event network-changed:67533239-6dc5-41d2-8ca9-e22a567dd861 for instance b5145486-a32b-4b05-bee7-16b16479ea69 on hv-cinder-73306 Sep 01 07:56:11.139650 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-04b33093-a87c-4a56-8830-9b7db323c98e req-060b6621-04fa-4bc9-a1b4-68c57f2c4cb8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031907 Sep 01 07:56:11.140389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1566/3147] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:11.188513 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4960dfa9-3ec2-4515-87f0-7e6b74938fc1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 204 len: 0 microversion: 2.1 time: 0.122167 Sep 01 07:56:11.189564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1582/3148] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:56:11 2022] DELETE /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:56:11.198209 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:11.199149 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:11.205451 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:11.205941 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:11.206525 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:11.207234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:11.207689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:11.208129 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:11.342906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:11.350750 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-be2a392b-edf0-4bf5-b423-6b090e27d55c tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1575 microversion: 2.1 time: 0.156886 Sep 01 07:56:11.351330 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1567/3149] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:11 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:12.127404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:12.128098 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:12.134345 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:12.134819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:12.135251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:12.135926 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:12.136879 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:12.137348 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:12.262675 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:12.270138 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4f43998-9b55-4a05-b030-e086afe1d7c3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1367 microversion: 2.1 time: 0.147048 Sep 01 07:56:12.270697 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1583/3150] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:12 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:12.371225 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:12.371845 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:12.378410 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:12.378896 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:12.379337 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:12.380028 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:12.380493 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:12.380919 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:12.512577 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:12.520962 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-bdfb4fc4-8b0f-4a61-a0e0-0f714201eea0 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1575 microversion: 2.1 time: 0.153672 Sep 01 07:56:12.521565 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1568/3151] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:12 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:13.291608 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:13.292551 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:13.300366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:13.300366 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:13.300764 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:13.301739 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:13.302286 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:13.303419 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:13.531332 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:13.542289 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ceffd928-837e-41e3-8226-e02fca0babef tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1367 microversion: 2.1 time: 0.254682 Sep 01 07:56:13.555604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1584/3152] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:13 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:13.555785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:13.555785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:13.555785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:13.555785 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:13.556462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:13.556462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:13.556462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:13.556462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:13.675446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-45ad0cd0-b127-443c-8d73-879cb06b1467 req-1aaf3e43-498a-4648-a99a-7f8ea92cc5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cfba9c6-35de-4d42-afa8-87b17035b49e", "name": "network-vif-plugged", "status": "completed", "tag": "eba5b51b-d72f-4192-a244-f09bf2890664"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:13.688829 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-45ad0cd0-b127-443c-8d73-879cb06b1467 req-1aaf3e43-498a-4648-a99a-7f8ea92cc5b0 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:13.689342 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-45ad0cd0-b127-443c-8d73-879cb06b1467 req-1aaf3e43-498a-4648-a99a-7f8ea92cc5b0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:13.689763 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-45ad0cd0-b127-443c-8d73-879cb06b1467 req-1aaf3e43-498a-4648-a99a-7f8ea92cc5b0 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:13.701780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-45ad0cd0-b127-443c-8d73-879cb06b1467 req-1aaf3e43-498a-4648-a99a-7f8ea92cc5b0 service nova] Creating event network-vif-plugged:eba5b51b-d72f-4192-a244-f09bf2890664 for instance 6cfba9c6-35de-4d42-afa8-87b17035b49e on hv-cinder-73306 Sep 01 07:56:13.706894 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-45ad0cd0-b127-443c-8d73-879cb06b1467 req-1aaf3e43-498a-4648-a99a-7f8ea92cc5b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035797 Sep 01 07:56:13.708116 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1585/3153] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:14.026176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:14.034161 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-8b5bb04f-57f6-482a-8ccb-566ee1bd5aec tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1575 microversion: 2.1 time: 0.494987 Sep 01 07:56:14.034735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1569/3154] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:13 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1575 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:14.131326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:14.132095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:14.136430 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ca507938-f9e6-4e69-b7ca-3577133502d1 req-75e37716-4f09-4837-85f0-44670701ae11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5145486-a32b-4b05-bee7-16b16479ea69", "name": "network-vif-deleted", "tag": "67533239-6dc5-41d2-8ca9-e22a567dd861"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:14.146651 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ca507938-f9e6-4e69-b7ca-3577133502d1 req-75e37716-4f09-4837-85f0-44670701ae11 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:14.147157 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ca507938-f9e6-4e69-b7ca-3577133502d1 req-75e37716-4f09-4837-85f0-44670701ae11 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:14.147590 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ca507938-f9e6-4e69-b7ca-3577133502d1 req-75e37716-4f09-4837-85f0-44670701ae11 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:14.158830 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ca507938-f9e6-4e69-b7ca-3577133502d1 req-75e37716-4f09-4837-85f0-44670701ae11 service nova] Creating event network-vif-deleted:67533239-6dc5-41d2-8ca9-e22a567dd861 for instance b5145486-a32b-4b05-bee7-16b16479ea69 on hv-cinder-73306 Sep 01 07:56:14.163619 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ca507938-f9e6-4e69-b7ca-3577133502d1 req-75e37716-4f09-4837-85f0-44670701ae11 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033097 Sep 01 07:56:14.164194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1586/3155] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:14.563230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:14.564408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:14.566396 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:14.572084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:14.572571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:14.573011 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:14.574291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:14.574745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:14.575173 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:14.705314 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:14.712934 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d1993f22-b687-49ab-8b0e-9dd7828bb2e6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1367 microversion: 2.1 time: 0.153718 Sep 01 07:56:14.713526 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1570/3156] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:14 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:15.055486 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:15.056175 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:15.062220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:15.062688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:15.063114 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:15.063782 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:15.064315 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:15.065049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:15.132247 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b2cf587dc44209a186fc453ac5bdfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5069d6a3a34a08bb00105a91251cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:15.140795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-376c9e28-a0c9-4eca-aed8-da287b1647b1 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 200 len: 1224 microversion: 2.1 time: 0.090080 Sep 01 07:56:15.141795 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1587/3157] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:15 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:15.733185 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:15.733808 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:15.740254 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:15.740775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:15.741231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:15.741931 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:15.742416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:15.742834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:15.871069 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:56:15.878678 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-708b799d-3c24-4fff-926f-5b67bc4d2488 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1558 microversion: 2.1 time: 0.150111 Sep 01 07:56:15.879376 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1571/3158] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:15 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:56:15.899035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:15.899480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:15.905715 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:15.906189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:15.906623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:15.907300 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:15.907743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:15.908164 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:15.987945 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f6909b0-7123-4b3c-a931-5e4d6fdedd88 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092715 Sep 01 07:56:15.988539 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1588/3159] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 07:56:15 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:16.162190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:16.162964 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: b5145486-a32b-4b05-bee7-16b16479ea69] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:16.169414 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:16.169912 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:16.170348 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:16.171045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:16.171592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:16.171933 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:16.186271 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] HTTP exception thrown: Instance b5145486-a32b-4b05-bee7-16b16479ea69 could not be found. Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Request method failure captured: Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 HTTP/1.1 Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGNkr8lnpoR11FWKs_K1nyCW65L6OpvAM7mUrgQHyMga3yJfBNGlpFJd1YN8ShTtdxTHO9QcNmvLvJ4Op4j_H6p4E-t4A70xjSw-KthWBT-rLof0FgaDnYOwp_DNAIJTfh1E7L6ToxA7W8rMH9QYw5WaVl18rKiWM7PryOPGLULqbD8 Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:56:16.187973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5069d6a3a34a08bb00105a91251cf2", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 93b2cf587dc44209a186fc453ac5bdfc Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance b5145486-a32b-4b05-bee7-16b16479ea69 could not be found. Sep 01 07:56:16.189231 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': 'b5145486-a32b-4b05-bee7-16b16479ea69'} Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5145486-a32b-4b05-bee7-16b16479ea69 could not be found. Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:56:16.189921 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5145486-a32b-4b05-bee7-16b16479ea69 could not be found. Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5145486-a32b-4b05-bee7-16b16479ea69 could not be found. Sep 01 07:56:16.190991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.191965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Returning 404 to user: Instance b5145486-a32b-4b05-bee7-16b16479ea69 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:56:16.191965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-e8ca20d0-c8bc-4295-8816-c3761257dcde tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69" status: 404 len: 111 microversion: 2.1 time: 0.031197 Sep 01 07:56:16.191965 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1572/3160] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:16 2022] GET /compute/v2.1/servers/b5145486-a32b-4b05-bee7-16b16479ea69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:56:16.631701 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:16.632231 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:16.641278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:16.641761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:16.642195 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:16.642875 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:16.643319 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:16.643741 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:16.657254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] HTTP exception thrown: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Request method failure captured: Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c HTTP/1.1 Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGNkr8lnpoR11FWKs_K1nyCW65L6OpvAM7mUrgQHyMga3yJfBNGlpFJd1YN8ShTtdxTHO9QcNmvLvJ4Op4j_H6p4E-t4A70xjSw-KthWBT-rLof0FgaDnYOwp_DNAIJTfh1E7L6ToxA7W8rMH9QYw5WaVl18rKiWM7PryOPGLULqbD8 Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:56:16.658895 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5069d6a3a34a08bb00105a91251cf2", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 93b2cf587dc44209a186fc453ac5bdfc Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.660308 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '9f5cefdc-d023-4097-bd9a-7b91c212112c'} Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:56:16.661146 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.662465 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.663855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Returning 404 to user: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:56:16.663855 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6df3b983-e9b6-4181-9e96-7ba09800a510 tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 404 len: 111 microversion: 2.1 time: 0.033069 Sep 01 07:56:16.663982 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1589/3161] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:56:16 2022] DELETE /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:56:16.669567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:16.670439 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] [instance: 9f5cefdc-d023-4097-bd9a-7b91c212112c] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:16.676345 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:16.676903 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:16.677501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:16.678187 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:16.678635 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:16.679054 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:16.692858 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] HTTP exception thrown: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Request method failure captured: Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c HTTP/1.1 Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGNkr8lnpoR11FWKs_K1nyCW65L6OpvAM7mUrgQHyMga3yJfBNGlpFJd1YN8ShTtdxTHO9QcNmvLvJ4Op4j_H6p4E-t4A70xjSw-KthWBT-rLof0FgaDnYOwp_DNAIJTfh1E7L6ToxA7W8rMH9QYw5WaVl18rKiWM7PryOPGLULqbD8 Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:56:16.694554 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5069d6a3a34a08bb00105a91251cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5069d6a3a34a08bb00105a91251cf2", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: df5069d6a3a34a08bb00105a91251cf2 Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-TestVolumeBootPattern-512668393 Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 93b2cf587dc44209a186fc453ac5bdfc Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-TestVolumeBootPattern-512668393-project Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.695998 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '9f5cefdc-d023-4097-bd9a-7b91c212112c'} Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:56:16.696753 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. Sep 01 07:56:16.697827 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:56:16.698778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Returning 404 to user: Instance 9f5cefdc-d023-4097-bd9a-7b91c212112c could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:56:16.698778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ac7f6bef-bd46-4cd8-94d1-443f608fd6dd tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c" status: 404 len: 111 microversion: 2.1 time: 0.030798 Sep 01 07:56:16.698778 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1573/3162] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:56:16 2022] GET /compute/v2.1/servers/9f5cefdc-d023-4097-bd9a-7b91c212112c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:56:16.932997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-bcf16981-a509-4bc0-8e63-0cfe05c0b068 req-4c62aa3b-6781-4ee5-9862-9596ebe701f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cfba9c6-35de-4d42-afa8-87b17035b49e", "tag": "eba5b51b-d72f-4192-a244-f09bf2890664"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:16.942082 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-bcf16981-a509-4bc0-8e63-0cfe05c0b068 req-4c62aa3b-6781-4ee5-9862-9596ebe701f8 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:16.942896 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-bcf16981-a509-4bc0-8e63-0cfe05c0b068 req-4c62aa3b-6781-4ee5-9862-9596ebe701f8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:16.943035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-bcf16981-a509-4bc0-8e63-0cfe05c0b068 req-4c62aa3b-6781-4ee5-9862-9596ebe701f8 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:16.956584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-bcf16981-a509-4bc0-8e63-0cfe05c0b068 req-4c62aa3b-6781-4ee5-9862-9596ebe701f8 service nova] Creating event network-changed:eba5b51b-d72f-4192-a244-f09bf2890664 for instance 6cfba9c6-35de-4d42-afa8-87b17035b49e on hv-cinder-73306 Sep 01 07:56:16.961404 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-bcf16981-a509-4bc0-8e63-0cfe05c0b068 req-4c62aa3b-6781-4ee5-9862-9596ebe701f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031978 Sep 01 07:56:16.962163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1590/3163] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:17.997877 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-b23420c7-eb57-4306-8fef-87454a2be3af tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] Calling method '.version_select at 0x7f78cf319ca0>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:18.021831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-b23420c7-eb57-4306-8fef-87454a2be3af tempest-TestVolumeBootPattern-512668393 tempest-TestVolumeBootPattern-512668393-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-159046410" status: 202 len: 0 microversion: 2.1 time: 0.028256 Sep 01 07:56:18.022633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1574/3164] 10.222.0.46 () {58 vars in 1260 bytes} [Thu Sep 1 07:56:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-159046410 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:56:52.988311 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:52.989161 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:52.993208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:56:52.993780 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:53.008144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:53.008618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:53.009047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:53.009751 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:53.010193 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:53.010612 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:53.036994 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1810280b-eab6-4715-91f8-bfba44e2fac0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/ips" status: 200 len: 150 microversion: 2.1 time: 0.050321 Sep 01 07:56:53.037584 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1591/3165] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:56:52 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:56:54.360294 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=38 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:54.361026 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:56:54.365175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e73ac4b4-46f4-4278-ac65-429bcb782414"}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:56:54.367452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:56:54.375811 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:54.376299 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:54.376735 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:54.377452 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:56:54.377905 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:56:54.378333 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:56:54.643883 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d9b5278b-1527-401b-a29d-572d3b71b8e2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284742 Sep 01 07:56:54.645218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1575/3166] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:56:54 2022] POST /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:57:02.158494 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e73ac4b4-46f4-4278-ac65-429bcb782414"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:57:02.160777 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:02.167095 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:02.167567 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:02.167995 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:02.168666 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:02.169110 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:02.169553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:02.245928 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Invalid volume: volume e73ac4b4-46f4-4278-ac65-429bcb782414 is already attached to instances: 6cfba9c6-35de-4d42-afa8-87b17035b49e Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: POST /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments HTTP/1.1 Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 74 Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:57:02.248133 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {"volumeAttachment": {"volumeId": "e73ac4b4-46f4-4278-ac65-429bcb782414"}} Sep 01 07:57:02.249654 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Invalid volume: volume e73ac4b4-46f4-4278-ac65-429bcb782414 is already attached to instances: 6cfba9c6-35de-4d42-afa8-87b17035b49e Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'server_id': '6cfba9c6-35de-4d42-afa8-87b17035b49e', 'body': {'volumeAttachment': {'volumeId': 'e73ac4b4-46f4-4278-ac65-429bcb782414'}}} Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e73ac4b4-46f4-4278-ac65-429bcb782414 is already attached to instances: 6cfba9c6-35de-4d42-afa8-87b17035b49e Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:57:02.250458 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e73ac4b4-46f4-4278-ac65-429bcb782414 is already attached to instances: 6cfba9c6-35de-4d42-afa8-87b17035b49e Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:57:02.251528 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:57:02.252616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:57:02.252616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:57:02.252616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:57:02.252616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e73ac4b4-46f4-4278-ac65-429bcb782414 is already attached to instances: 6cfba9c6-35de-4d42-afa8-87b17035b49e Sep 01 07:57:02.252616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:57:02.252616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 400 to user: Invalid volume: volume e73ac4b4-46f4-4278-ac65-429bcb782414 is already attached to instances: 6cfba9c6-35de-4d42-afa8-87b17035b49e {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:57:02.252616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1d624e45-cd7f-476a-9ad3-b26eaa8b4a69 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095015 Sep 01 07:57:02.252616 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1592/3167] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:57:02 2022] POST /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 07:57:02.313243 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:02.313820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:02.319857 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:02.320336 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:02.320769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:02.321482 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:02.321932 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:02.322354 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:02.401190 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lazy-loading 'services' on Instance uuid 6cfba9c6-35de-4d42-afa8-87b17035b49e {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:57:02.475879 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-213d4963-d986-4fde-b5ec-fe0470c661f1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments/e73ac4b4-46f4-4278-ac65-429bcb782414" status: 202 len: 0 microversion: 2.1 time: 0.167486 Sep 01 07:57:02.476511 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1576/3168] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:57:02 2022] DELETE /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments/e73ac4b4-46f4-4278-ac65-429bcb782414 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:57:02.487359 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:02.489637 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:02.495647 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:02.496210 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:02.496669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:02.497936 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:02.498376 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:02.498790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:02.529521 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70728859-e8be-40f2-b968-b3c7940e6869 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048580 Sep 01 07:57:02.530278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1593/3169] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:57:02 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:57:03.541769 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:03.544155 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:03.550990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:03.551469 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:03.551906 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:03.552592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:03.553041 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:03.553494 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:03.583741 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-19f92119-ec81-49f3-9798-c374a3f9c479 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046158 Sep 01 07:57:03.584217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1577/3170] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:57:03 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:57:03.644392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:03.644884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:03.651421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:03.651899 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:03.652330 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:03.653006 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:03.653809 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:03.654213 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:03.679604 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:57:03.752368 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54af0d97-816f-46d9-a86d-9c4467acd5a4 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 204 len: 0 microversion: 2.1 time: 0.111550 Sep 01 07:57:03.753535 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1594/3171] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:57:03 2022] DELETE /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:57:03.761796 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:03.762426 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:03.769445 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:03.769710 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:03.770168 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:03.770867 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:03.771321 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:03.771745 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:03.901184 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:03.909079 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-978cf562-388e-4d05-8a34-8767c5e7fdb8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1682 microversion: 2.1 time: 0.151751 Sep 01 07:57:03.909662 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1578/3172] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:03 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:04.931609 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:04.932304 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:04.938532 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:04.939004 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:04.939427 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:04.940099 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:04.940537 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:04.940947 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:05.067773 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:05.076102 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-442516b3-f74f-4653-9cbb-03f0a7e32c37 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1682 microversion: 2.1 time: 0.148542 Sep 01 07:57:05.076669 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1595/3173] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:04 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:06.097636 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:06.098371 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:06.104894 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:06.105480 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:06.105991 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:06.106702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:06.107170 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:06.107592 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:06.301638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:06.309690 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-16c09290-df97-4d58-88c8-2679804374fe tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 200 len: 1682 microversion: 2.1 time: 0.215968 Sep 01 07:57:06.310576 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1579/3174] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:06 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:06.638948 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b4e3a2ba-ad3c-423f-b20d-44690ae8ec41 req-6d8011e4-6af0-4b78-b32b-68ffccee4f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cfba9c6-35de-4d42-afa8-87b17035b49e", "name": "network-vif-deleted", "tag": "eba5b51b-d72f-4192-a244-f09bf2890664"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:57:06.650001 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b4e3a2ba-ad3c-423f-b20d-44690ae8ec41 req-6d8011e4-6af0-4b78-b32b-68ffccee4f40 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:06.650480 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b4e3a2ba-ad3c-423f-b20d-44690ae8ec41 req-6d8011e4-6af0-4b78-b32b-68ffccee4f40 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:06.650908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b4e3a2ba-ad3c-423f-b20d-44690ae8ec41 req-6d8011e4-6af0-4b78-b32b-68ffccee4f40 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:06.663040 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b4e3a2ba-ad3c-423f-b20d-44690ae8ec41 req-6d8011e4-6af0-4b78-b32b-68ffccee4f40 service nova] Creating event network-vif-deleted:eba5b51b-d72f-4192-a244-f09bf2890664 for instance 6cfba9c6-35de-4d42-afa8-87b17035b49e on hv-cinder-73306 Sep 01 07:57:06.668015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b4e3a2ba-ad3c-423f-b20d-44690ae8ec41 req-6d8011e4-6af0-4b78-b32b-68ffccee4f40 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033409 Sep 01 07:57:06.668623 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1596/3175] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:57:07.332232 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:07.332953 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:07.339039 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:07.339566 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:07.339974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:07.340689 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:07.341150 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:07.341559 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:07.357368 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e HTTP/1.1 Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:57:07.359567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:57:07.361176 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '6cfba9c6-35de-4d42-afa8-87b17035b49e'} Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:57:07.362023 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:57:07.363411 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:57:07.365369 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:57:07.366234 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-90ae4c91-cbec-4124-8745-2a4147d3bb71 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 404 len: 111 microversion: 2.1 time: 0.038694 Sep 01 07:57:07.366787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1580/3176] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:07 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:57:07.376254 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-794e2367-3e90-4cf6-a1bb-e885c3c552a1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '.version_select at 0x7f78cf1f2af0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:07.395433 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-794e2367-3e90-4cf6-a1bb-e885c3c552a1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209860697" status: 202 len: 0 microversion: 2.1 time: 0.023786 Sep 01 07:57:07.396013 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1597/3177] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Sep 1 07:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209860697 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 07:57:08.007990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-92b476af-6b52-4760-8215-7a9c3c46da5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: .version_select at 0x7f78cf317af0>, body: {"keypair": {"name": "tempest-keypair-1420542608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+ZnxP2bXnsvMfFV6ZHXIC+wbDog07gLfQFSxf4pQy7rNk4enhbEMzuaCZX6pNKy9ChfpoSQeh46Iic5i3+KndzZ/JBiHUC1UK4P1l7BJy+7qO/LIEYFlIpcENnlYenJw=="}} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:57:08.022841 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-92b476af-6b52-4760-8215-7a9c3c46da5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for project 462cfcb8aad746289ff3c2a01219da07. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:57:08.026606 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.quota [None req-92b476af-6b52-4760-8215-7a9c3c46da5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for user 135b44145a1d4712b0ea9b3f00d1bc30 and project 462cfcb8aad746289ff3c2a01219da07. Resources: {'key_pairs'} {{(pid=120638) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:57:08.048702 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-92b476af-6b52-4760-8215-7a9c3c46da5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044548 Sep 01 07:57:08.049302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1581/3178] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 07:57:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:57:09.262515 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1986199601", "imageRef": "07bef70b-247a-46ad-9f03-bdaaa047dc71", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9d7a663-68d9-4284-b194-c8aec96e9400"}], "security_groups": [{"name": "tempest-securitygroup--2029841580"}], "key_name": "tempest-keypair-1420542608", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:57:09.369283 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] validate_networks() for [('b9d7a663-68d9-4284-b194-c8aec96e9400', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 07:57:10.007586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 07:57:10.008000 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 07:57:10.008461 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 07:57:10.008857 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 07:57:10.009303 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 07:57:10.018466 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:10.018933 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:10.019360 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:10.020064 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:10.020536 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:10.020954 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:10.039968 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for project 462cfcb8aad746289ff3c2a01219da07. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 07:57:10.043843 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Getting quotas for user 135b44145a1d4712b0ea9b3f00d1bc30 and project 462cfcb8aad746289ff3c2a01219da07. Resources: {'cores', 'instances', 'ram'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 07:57:10.054323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 07:57:10.056617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07bef70b-247a-46ad-9f03-bdaaa047dc71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 07:57:10.103435 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-656cb90d-fbe3-4f4c-b395-cf4a80411d5f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.845356 Sep 01 07:57:10.104066 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1598/3179] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 07:57:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 07:57:10.115814 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f8cf26dc-87b8-49d3-8aba-d4c8b771618a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:10.116432 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f8cf26dc-87b8-49d3-8aba-d4c8b771618a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:10.171419 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f8cf26dc-87b8-49d3-8aba-d4c8b771618a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:10.178302 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f8cf26dc-87b8-49d3-8aba-d4c8b771618a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1242 microversion: 2.1 time: 0.066808 Sep 01 07:57:10.178866 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1582/3180] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:10 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:11.198959 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:11.199564 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:11.206850 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:11.207322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:11.207753 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:11.208429 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:11.208871 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:11.209322 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:11.268964 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:11.276446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42924a9d-2c86-49d8-bbc0-e141ea5029b2 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1302 microversion: 2.1 time: 0.081421 Sep 01 07:57:11.277015 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1599/3181] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:11 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:12.296601 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:12.297246 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:12.303787 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:12.304276 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:12.304837 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:12.305594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:12.306656 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:12.307148 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:12.551672 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:12.559239 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-579b9c29-acd5-459a-9367-77f88363ce56 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1368 microversion: 2.1 time: 0.266741 Sep 01 07:57:12.560000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1583/3182] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:12 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:12.954510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-51f0bcdd-ffe1-43c5-9e2a-3f6b1f6bb28f req-34afc84b-56e0-45b7-9fbe-447751b562a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9800aa72-5d83-4b84-8f66-f8c40f5eb692", "tag": "f6f31d15-28b3-403c-b6ce-d92994edeba3"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:57:12.964170 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-51f0bcdd-ffe1-43c5-9e2a-3f6b1f6bb28f req-34afc84b-56e0-45b7-9fbe-447751b562a7 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:12.964642 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-51f0bcdd-ffe1-43c5-9e2a-3f6b1f6bb28f req-34afc84b-56e0-45b7-9fbe-447751b562a7 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:12.965069 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-51f0bcdd-ffe1-43c5-9e2a-3f6b1f6bb28f req-34afc84b-56e0-45b7-9fbe-447751b562a7 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:12.975706 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-51f0bcdd-ffe1-43c5-9e2a-3f6b1f6bb28f req-34afc84b-56e0-45b7-9fbe-447751b562a7 service nova] Creating event network-changed:f6f31d15-28b3-403c-b6ce-d92994edeba3 for instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 on hv-cinder-73306 Sep 01 07:57:12.980658 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-51f0bcdd-ffe1-43c5-9e2a-3f6b1f6bb28f req-34afc84b-56e0-45b7-9fbe-447751b562a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030010 Sep 01 07:57:12.981266 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1600/3183] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:57:13.581213 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:13.581834 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:13.588196 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:13.588680 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:13.589137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:13.589835 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:13.590291 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:13.590727 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:13.722217 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:13.729792 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-47f8f029-a643-47d8-90ad-c0b6ed2c9602 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1368 microversion: 2.1 time: 0.153411 Sep 01 07:57:13.730349 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1584/3184] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:13 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:14.751256 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:14.752859 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:14.759169 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:14.759650 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:14.760093 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:14.761240 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:14.761700 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:14.762121 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:14.892902 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:14.900403 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f67b097e-c174-463c-9a72-689abb9e17d6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1368 microversion: 2.1 time: 0.153947 Sep 01 07:57:14.900961 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1601/3185] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:14 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:15.923630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:15.924171 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:15.930504 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:15.930990 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:15.931424 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:15.932118 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:15.932568 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:15.933045 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:16.077850 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:16.085449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-dcd2df6f-46e4-4cc6-a6b8-96f958355c05 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1368 microversion: 2.1 time: 0.167513 Sep 01 07:57:16.086016 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1585/3186] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:15 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:17.105046 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:17.105685 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:17.112094 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:17.112571 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:17.113003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:17.113712 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:17.114159 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:17.114580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:17.239115 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:17.246648 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-078185a9-b43a-4b1c-9a6d-8d21b9698dac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1368 microversion: 2.1 time: 0.145476 Sep 01 07:57:17.247207 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1602/3187] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:17 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:18.029458 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [req-003df4be-6f5f-45c2-8af0-3ebd9f9ae31d req-0da4e410-b352-4872-b10f-11988678a9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9800aa72-5d83-4b84-8f66-f8c40f5eb692", "name": "network-vif-plugged", "status": "completed", "tag": "f6f31d15-28b3-403c-b6ce-d92994edeba3"}]} {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:57:18.040604 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-003df4be-6f5f-45c2-8af0-3ebd9f9ae31d req-0da4e410-b352-4872-b10f-11988678a9ca service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:18.041091 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-003df4be-6f5f-45c2-8af0-3ebd9f9ae31d req-0da4e410-b352-4872-b10f-11988678a9ca service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:18.041545 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [req-003df4be-6f5f-45c2-8af0-3ebd9f9ae31d req-0da4e410-b352-4872-b10f-11988678a9ca service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:18.053474 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.compute.server_external_events [req-003df4be-6f5f-45c2-8af0-3ebd9f9ae31d req-0da4e410-b352-4872-b10f-11988678a9ca service nova] Creating event network-vif-plugged:f6f31d15-28b3-403c-b6ce-d92994edeba3 for instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 on hv-cinder-73306 Sep 01 07:57:18.058638 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [req-003df4be-6f5f-45c2-8af0-3ebd9f9ae31d req-0da4e410-b352-4872-b10f-11988678a9ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033127 Sep 01 07:57:18.059392 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1586/3188] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:57:18.267781 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:18.268305 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:18.274596 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:18.275075 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:18.275506 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:18.276194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:18.276641 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:18.277060 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:18.426194 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:18.433790 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91518b65-812d-4140-bb27-bc84f78ee809 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1368 microversion: 2.1 time: 0.170062 Sep 01 07:57:18.434351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1603/3189] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:18 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:19.454251 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:19.454861 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:19.461440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:19.461915 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:19.462450 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:19.463128 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:19.463575 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:19.464000 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:19.592344 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:19.600440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2a73a648-1936-49a6-89e7-b5caadd396d0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1368 microversion: 2.1 time: 0.150636 Sep 01 07:57:19.601002 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1587/3190] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:19 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:20.620897 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:20.621525 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:20.623912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:57:20.624553 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:57:20.630720 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:20.631189 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:20.631617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:20.632281 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:20.632718 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:20.633136 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:20.757884 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:57:20.766112 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-44d16cd5-d828-4efa-86e1-e5fac6cc393a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1558 microversion: 2.1 time: 0.148422 Sep 01 07:57:20.766726 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1604/3191] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:57:20 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:57:20.786230 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:20.786781 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:20.788705 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell0:SELECT=6 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:57:20.794717 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:20.795202 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:20.795641 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:20.796335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:20.796793 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:20.797252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:20.875406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-d3b62f3b-f641-44d7-8b13-f64c2b8d1fac tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092471 Sep 01 07:57:20.876120 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1588/3192] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 07:57:20 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 07:57:21.978580 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f92494a9-8dfc-4777-a53b-ed7c1bd01e31 req-f415a4a7-f45b-4f1a-a137-2d53c32879f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9800aa72-5d83-4b84-8f66-f8c40f5eb692", "tag": "f6f31d15-28b3-403c-b6ce-d92994edeba3"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:57:21.988326 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f92494a9-8dfc-4777-a53b-ed7c1bd01e31 req-f415a4a7-f45b-4f1a-a137-2d53c32879f1 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:21.988801 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f92494a9-8dfc-4777-a53b-ed7c1bd01e31 req-f415a4a7-f45b-4f1a-a137-2d53c32879f1 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:21.989278 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f92494a9-8dfc-4777-a53b-ed7c1bd01e31 req-f415a4a7-f45b-4f1a-a137-2d53c32879f1 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:22.002312 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f92494a9-8dfc-4777-a53b-ed7c1bd01e31 req-f415a4a7-f45b-4f1a-a137-2d53c32879f1 service nova] Creating event network-changed:f6f31d15-28b3-403c-b6ce-d92994edeba3 for instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 on hv-cinder-73306 Sep 01 07:57:22.008678 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f92494a9-8dfc-4777-a53b-ed7c1bd01e31 req-f415a4a7-f45b-4f1a-a137-2d53c32879f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033840 Sep 01 07:57:22.009323 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1605/3193] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:57:58.128495 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 07:57:58.129046 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Thu Sep 1 07:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/ips (ip 10.222.0.46) !!! Sep 01 07:57:58.129764 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:57:58.130674 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG dbcounter [-] [120638] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:57:58.134517 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:57:58.135014 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:58.144593 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:58.145081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:58.145539 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:58.146218 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:58.146666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:58.147084 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:58.171428 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-c126f24f-644e-4116-890d-905230439548 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/ips" status: 200 len: 150 microversion: 2.1 time: 0.044787 Sep 01 07:57:58.171983 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1589/3194] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 07:57:58 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:57:59.497613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:57:59.498351 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 07:57:59.503309 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26778fce-c09f-48df-a1e1-465600858b05"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:57:59.505708 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:57:59.513787 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:59.514268 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:59.514703 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:59.515383 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:57:59.515862 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:57:59.516284 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:57:59.793688 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96557e1a-07f8-4d11-959b-0ac636b47b9a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "POST /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297851 Sep 01 07:57:59.794290 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1606/3195] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 07:57:59 2022] POST /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:58:07.413775 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:07.414312 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:07.420409 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:07.420890 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:07.421370 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:07.422057 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:07.422515 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:07.422946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:07.503320 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lazy-loading 'services' on Instance uuid 9800aa72-5d83-4b84-8f66-f8c40f5eb692 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:58:07.573859 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-31b036a6-bf34-40bd-bfd2-32315c9ba9f3 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-volume_attachments/26778fce-c09f-48df-a1e1-465600858b05" status: 202 len: 0 microversion: 2.1 time: 0.163912 Sep 01 07:58:07.574431 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1590/3196] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 07:58:07 2022] DELETE /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-volume_attachments/26778fce-c09f-48df-a1e1-465600858b05 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:58:07.583761 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:07.586087 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:07.592438 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:07.592955 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:07.593529 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:07.594318 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:07.594963 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:07.595390 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:07.626090 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9050b1f5-2c70-4fe8-9bed-03b0ca6132a7 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047169 Sep 01 07:58:07.627504 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1607/3197] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:58:07 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:58:08.640085 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:08.643047 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:08.649248 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:08.649734 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:08.650169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:08.650852 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:08.651303 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:08.651728 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:08.679911 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-4fef5635-f0dc-4181-8c04-2bbadbc48be8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044683 Sep 01 07:58:08.680462 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1591/3198] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 07:58:08 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 07:58:08.743503 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:08.744034 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:08.750369 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:08.750842 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:08.751273 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:08.752484 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:08.752930 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:08.753371 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:08.778618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 07:58:08.851097 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e3b6c1e-8070-44cc-9f3a-b11208af80b6 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 204 len: 0 microversion: 2.1 time: 0.111128 Sep 01 07:58:08.851821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1608/3199] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:58:08 2022] DELETE /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 07:58:08.859820 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:08.860440 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:08.866487 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:08.866974 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:08.867408 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:08.868096 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:08.868549 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:08.868973 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:08.999571 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:58:09.007698 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-f42074e0-0c01-4161-a1c5-55c3a2aa3963 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1683 microversion: 2.1 time: 0.151703 Sep 01 07:58:09.008252 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1592/3200] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:08 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:58:10.029821 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:10.030520 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:10.036969 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:10.037477 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:10.037910 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:10.038586 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:10.039030 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:10.039446 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:10.166752 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:58:10.175251 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65b74d93-8b49-4411-9039-93e8aa627ec8 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1683 microversion: 2.1 time: 0.149996 Sep 01 07:58:10.175816 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1609/3201] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:10 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:58:11.196119 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:11.196823 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:11.203165 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:11.203646 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:11.204081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:11.205385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:11.205843 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:11.206335 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:11.401666 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:58:11.409567 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-2dcc6320-faf5-4edc-be57-4f0d679d8ee1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1683 microversion: 2.1 time: 0.217294 Sep 01 07:58:11.410110 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1593/3202] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:11 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:58:11.783385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4a088643-339e-43f1-b0d0-d8cd9755dc77 req-544e4f3f-cb42-4eb1-85b7-459678afb711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9800aa72-5d83-4b84-8f66-f8c40f5eb692", "name": "network-vif-deleted", "tag": "f6f31d15-28b3-403c-b6ce-d92994edeba3"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 07:58:11.793385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4a088643-339e-43f1-b0d0-d8cd9755dc77 req-544e4f3f-cb42-4eb1-85b7-459678afb711 service nova] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:11.793946 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4a088643-339e-43f1-b0d0-d8cd9755dc77 req-544e4f3f-cb42-4eb1-85b7-459678afb711 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:11.794454 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4a088643-339e-43f1-b0d0-d8cd9755dc77 req-544e4f3f-cb42-4eb1-85b7-459678afb711 service nova] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:11.806479 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4a088643-339e-43f1-b0d0-d8cd9755dc77 req-544e4f3f-cb42-4eb1-85b7-459678afb711 service nova] Creating event network-vif-deleted:f6f31d15-28b3-403c-b6ce-d92994edeba3 for instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 on hv-cinder-73306 Sep 01 07:58:11.811144 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4a088643-339e-43f1-b0d0-d8cd9755dc77 req-544e4f3f-cb42-4eb1-85b7-459678afb711 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032230 Sep 01 07:58:11.812068 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1610/3203] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 07:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 07:58:12.431719 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:12.432553 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:12.440416 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:12.440900 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:12.441633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:12.442377 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:12.443086 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:12.443514 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:12.479594 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:12.480081 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:12.480513 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:12.480961 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.objects.instance [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lazy-loading 'fault' on Instance uuid 9800aa72-5d83-4b84-8f66-f8c40f5eb692 {{(pid=120638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 07:58:12.526863 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.policy [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135b44145a1d4712b0ea9b3f00d1bc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cfcb8aad746289ff3c2a01219da07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120638) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 07:58:12.535206 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-1d69a5ff-272a-470f-842b-939fbbf8558c tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 200 len: 1332 microversion: 2.1 time: 0.107566 Sep 01 07:58:12.535688 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1594/3204] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:12 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 07:58:13.557618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:13.558313 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:13.565140 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:13.565617 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:13.566049 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:13.566724 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:13.567168 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:13.567588 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:13.580510 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 HTTP/1.1 Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:58:13.582171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:13.583662 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '9800aa72-5d83-4b84-8f66-f8c40f5eb692'} Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:13.584471 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:13.585978 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:13.587208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:13.587208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aec76476-9628-4a25-bce9-b73019dda908 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 404 len: 111 microversion: 2.1 time: 0.030593 Sep 01 07:58:13.587208 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1611/3205] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:13 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:58:13.592422 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ba83dcfc-8cd6-40d4-8cf3-e05493b7479f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '.version_select at 0x7f78cf320790>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:13.611757 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ba83dcfc-8cd6-40d4-8cf3-e05493b7479f tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420542608" status: 202 len: 0 microversion: 2.1 time: 0.023132 Sep 01 07:58:13.612304 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1595/3206] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Sep 1 07:58:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420542608 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 07:58:15.322743 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:15.323233 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:15.329618 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:15.330089 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:15.330517 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:15.331188 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:15.331630 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:15.332047 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:15.348187 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 HTTP/1.1 Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:58:15.349786 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.351220 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '9800aa72-5d83-4b84-8f66-f8c40f5eb692'} Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:15.352024 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.353350 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.354819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:15.354819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2765645-dd93-44b0-9a0e-d4b699236946 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 404 len: 111 microversion: 2.1 time: 0.032202 Sep 01 07:58:15.354819 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1612/3207] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:58:15 2022] DELETE /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:58:15.359871 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:15.360534 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 9800aa72-5d83-4b84-8f66-f8c40f5eb692] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:15.367709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:15.368194 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:15.368629 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:15.369355 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:15.369806 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:15.370233 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:15.383035 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 HTTP/1.1 Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:58:15.384675 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.386166 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '9800aa72-5d83-4b84-8f66-f8c40f5eb692'} Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:15.386902 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. Sep 01 07:58:15.388201 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:15.389406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 9800aa72-5d83-4b84-8f66-f8c40f5eb692 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:15.389406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-420fbd01-da21-4394-9d5b-5b13e6dd83c1 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692" status: 404 len: 111 microversion: 2.1 time: 0.030552 Sep 01 07:58:15.389406 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1596/3208] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:15 2022] GET /compute/v2.1/servers/9800aa72-5d83-4b84-8f66-f8c40f5eb692 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:58:16.523512 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:16.524165 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:16.530613 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:16.531079 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:16.531501 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:16.532163 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:16.532598 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:16.533005 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:16.546127 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e HTTP/1.1 Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:58:16.547634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.549607 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '6cfba9c6-35de-4d42-afa8-87b17035b49e'} Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:16.550385 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.551524 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.552634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:16.552634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cad14ddf-db26-46cf-b765-981d3312e4af tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 404 len: 111 microversion: 2.1 time: 0.029333 Sep 01 07:58:16.552634 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1613/3209] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:58:16 2022] DELETE /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:58:16.557833 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:16.558453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6cfba9c6-35de-4d42-afa8-87b17035b49e] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:16.565442 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:16.565947 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:16.566385 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:16.567074 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:16.567527 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:16.567954 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:16.582449 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e HTTP/1.1 Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:58:16.583949 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.585453 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '6cfba9c6-35de-4d42-afa8-87b17035b49e'} Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:16.586175 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. Sep 01 07:58:16.587479 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.588633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 6cfba9c6-35de-4d42-afa8-87b17035b49e could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:16.588633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-59b4c301-0795-49f2-9d6a-02ef00ed29c0 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e" status: 404 len: 111 microversion: 2.1 time: 0.031322 Sep 01 07:58:16.588633 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1597/3210] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:16 2022] GET /compute/v2.1/servers/6cfba9c6-35de-4d42-afa8-87b17035b49e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:58:16.593508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:16.593997 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:16.599856 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:16.600328 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:16.600757 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:16.601463 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:16.601908 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:16.602321 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:16.616255 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 HTTP/1.1 Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:58:16.617791 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.619171 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': 'de89439d-109f-49e7-a3e0-5a6b0cd48b23'} Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:16.619960 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.621269 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.622563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:16.622563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c54a370-48fb-4138-bc8a-c6da422acb59 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 404 len: 111 microversion: 2.1 time: 0.029460 Sep 01 07:58:16.622563 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1614/3211] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:58:16 2022] DELETE /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:58:16.627963 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:16.628616 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: de89439d-109f-49e7-a3e0-5a6b0cd48b23] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:16.634630 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:16.635115 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:16.635552 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:16.636236 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:16.636695 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:16.637137 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:16.650241 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 HTTP/1.1 Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:58:16.651776 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.653169 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': 'de89439d-109f-49e7-a3e0-5a6b0cd48b23'} Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:16.654105 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. Sep 01 07:58:16.655709 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:16.656917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance de89439d-109f-49e7-a3e0-5a6b0cd48b23 could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:16.656917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-ccb71e80-7470-4fb1-8225-abf20c7ea36a tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23" status: 404 len: 111 microversion: 2.1 time: 0.029655 Sep 01 07:58:16.656917 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1598/3212] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:16 2022] GET /compute/v2.1/servers/de89439d-109f-49e7-a3e0-5a6b0cd48b23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:58:17.793508 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:17.794003 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:17.800912 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:17.801421 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:17.801854 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:17.802527 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:17.802971 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:17.803392 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:17.816422 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b HTTP/1.1 Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Connection: close Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Host: 10.222.0.46 Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Role: member,reader Sep 01 07:58:17.818035 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Roles: member,reader Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: method: > Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: exception: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.819338 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: action_args: {'id': '6e78c7ca-ab86-4f88-a871-7c1f7d8b421b'} Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:17.820010 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.821400 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.822911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:17.822911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2abecd6-9889-46d6-9acf-38d0f347ac99 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 404 len: 111 microversion: 2.1 time: 0.029759 Sep 01 07:58:17.822911 dv-cinder-733062-35-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1615/3213] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 07:58:17 2022] DELETE /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 07:58:17.827926 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Calling method '>' {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 07:58:17.828540 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.compute.api [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] [instance: 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b] Fetching instance by UUID {{(pid=120638) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 07:58:17.834920 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:17.835399 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:17.835831 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:17.836501 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Acquiring lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 07:58:17.836946 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 07:58:17.837389 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG oslo_concurrency.lockutils [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Lock "6d062ee7-b5da-4503-94b9-816b45d5ae94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 07:58:17.850957 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.wsgi [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] HTTP exception thrown: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Request method failure captured: Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: request: GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b HTTP/1.1 Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept: application/json Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Accept-Encoding: identity Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Connection: close Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Length: 0 Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Content-Type: application/json Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Host: 10.222.0.46 Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: Openstack-System-Scope: None Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: User-Agent: python-urllib3/1.26.12 Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Auth-Token: gAAAAABjEGUY1nwOa4NLaZvtA4V8DM-wwQLG_0msVWud58CTJuauovoQXkMV2DoY7-moYCYQj1fWVXq6ZOarZytc3DeZPq0mQdB6mkobNNRYgN5g_-SXDMNBX6NqV07WtZE028b_pmBHb5J7VHAsnGvpzHMtLNnaJnwcbNugfSNR2p3XozfPt48 Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Id: None Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Domain-Name: None Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Identity-Status: Confirmed Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Is-Admin-Project: True Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Id: default Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Domain-Name: Default Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Project-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Role: member,reader Sep 01 07:58:17.852464 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Roles: member,reader Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/462cfcb8aad746289ff3c2a01219da07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_462cfcb8aad746289ff3c2a01219da07", "adminURL": "http://10.222.0.46:8080"}]}] Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Id: 462cfcb8aad746289ff3c2a01219da07 Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-235975351 Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Id: default Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Domain-Name: Default Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Id: 135b44145a1d4712b0ea9b3f00d1bc30 Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: X-User-Name: tempest-AttachVolumeNegativeTest-235975351-project Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: method: > Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: exception: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.853940 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: action_args: {'id': '6e78c7ca-ab86-4f88-a871-7c1f7d8b421b'} Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: {{(pid=120638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 07:58:17.854810 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. Sep 01 07:58:17.856087 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: ERROR nova.api.openstack.wsgi Sep 01 07:58:17.857258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: DEBUG nova.api.openstack.wsgi [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] Returning 404 to user: Instance 6e78c7ca-ab86-4f88-a871-7c1f7d8b421b could not be found. {{(pid=120638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 07:58:17.857258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: INFO nova.api.openstack.requestlog [None req-3ea73a1a-5e58-45da-924b-ed05fa8d7588 tempest-AttachVolumeNegativeTest-235975351 tempest-AttachVolumeNegativeTest-235975351-project] 10.222.0.46 "GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b" status: 404 len: 111 microversion: 2.1 time: 0.029735 Sep 01 07:58:17.857258 dv-cinder-733062-35-iscsi devstack@n-api.service[120638]: [pid: 120638|app: 0|req: 1599/3214] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 07:58:17 2022] GET /compute/v2.1/servers/6e78c7ca-ab86-4f88-a871-7c1f7d8b421b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)